Microsoft Fabric at Build 2026
My Recommended Session List
Jun 11, 20264 min read82
Command Palette
Search for a command to run...
#data-engineering
Articles tagged with #data-engineering
Migrate workloads to Delta Lake
Migration Guide
Jul 31, 20243 min read4
Databricks Unified Data Analytics Platform
Jul 2, 20221 min read1Data Pipelines Pocket Reference
Moving and Processing Data for Analytics
Jul 26, 20211 min read
Spark: Count number of duplicate row
To count the number of duplicate rows in a pyspark DataFrame, you want to groupBy() all the columns and count(), then select the sum of the counts for the rows where the count is greater than 1: import pyspark.sql.functions as funcs df.groupBy(df.col...
Jul 12, 20211 min read4
Apache Spark Programming with Databricks
Databricks Workspaces A databricks workspace is an environment for accessing all of your databricks assets. The workspace organizes object such as notebooks, libraries, and experiments into folders and it provides access to data and computational res...
Jul 4, 20214 min read2