Skip to content
Srinimf

Srinimf

  • Quick SQL Interview Questions for Data Engineers (Little Tricky)

    Apr 26, 2026

    ·

    SQL
    Quick SQL Interview Questions for Data Engineers (Little Tricky)
  • Python Interview Questions: TechM & Synecron

    The content covers TechM and Synecron interview questions, including substring replacement, list flattening, and PySpark dataframe splitting. Read More ⇢

    Python Interview Questions: TechM & Synecron
  • Understanding Stored Procedures vs Functions in SQL

    Stored procedures and functions serve different purposes in databases. Procedures handle operations, while functions perform calculations and return values. Read More ⇢

    Understanding Stored Procedures vs Functions in SQL
  • Step-by-Step Guide to Reading Parquet Files in Spark

    When Spark reads a Parquet file, it distributes data across the cluster for parallel processing, ensuring high-performance processing. Read More ⇢

    Step-by-Step Guide to Reading Parquet Files in Spark
  • Databricks Spark Optimizations: User-Defined vs. Databricks-Provided

    Databricks optimizations include user-defined techniques like partitioning and caching, and Databricks-provided features like Catalyst and Delta optimizations. Read More ⇢

    Databricks Spark Optimizations: User-Defined vs. Databricks-Provided
  • PySpark Storage Levels: Choosing the Right One for Optimal Performance

    Learn about different storage levels in PySpark and choose the right one for optimal performance and resource utilization. Storage Levels in PySpark Here’s a comparison of MEMORY_AND_DISK with other storage levels: MEMORY_ONLY: MEMORY_ONLY_SER: MEMORY_AND_DISK: MEMORY_AND_DISK_SER: DISK_ONLY: OFF_HEAP: Key Considerations Choose the appropriate storage level based on your data size. Consider… Read More ⇢

    PySpark Storage Levels: Choosing the Right One for Optimal Performance
  • Mastering PySpark select() Method: Advanced Column Operations

    In PySpark, the select() is used to select specific columns from a DataFrame. It allows you to perform various operations on the columns, including renaming them, applying functions, and more. Here’s a breakdown of how you can use it, and the methods/functions that can be applied within it. Basic Usage… Read More ⇢

    Mastering PySpark select() Method: Advanced Column Operations
  • PySpark DataFrame: Counting NULL Values in Each Column

    To count the number of NULL values in each column of a PySpark DataFrame, you can use the isNull() function. Use this function with the agg method to compute the counts. PySpark’s isNull() method checks for NULL values, and then you can aggregate these checks to count them. RelatedCSV Column… Read More ⇢

    PySpark DataFrame: Counting NULL Values in Each Column
  • PySpark DataFrame: Common Operations Cheat Sheet

    In PySpark, many methods are directly available on DataFrame objects and other classes, so no separate import is needed. Here’s a cheat sheet of common PySpark methods. 1. DataFrame Methods These methods are directly available on DataFrame objects: 2. Spark Session Methods These methods are directly available on the SparkSession… Read More ⇢

    PySpark DataFrame: Common Operations Cheat Sheet
  • Parquet vs ORC vs Avro: Top Differences Explained

    This content compares the performance and features of three data formats: Parquet, ORC, and AVRO. Parquet and ORC are columnar formats optimizing storage and query performance, while AVRO is row-oriented, supporting schema evolution for varied workloads. Each format is suited for specific big data applications, emphasizing efficiency and compatibility. Read More ⇢

    Parquet vs ORC vs Avro: Top Differences Explained
«Prev
1 … 20 21 22 23 24 … 238
Next»

About Srinimf

We share solutions for software developers and interview questions.

2,800,854 Total views

Subscribe for DAILY TIPS

Join our mailing list to stay notified about new blog posts. No spam, we guarantee.

  • Home
  • About Srini
  • Contact
  • Page Store

Log in
  • Tumblr
  • Facebook
  • Instagram
  • WordPress
  • X

Srinimf

Designed with WordPress

Loading Comments...

You must be logged in to post a comment.