Big Data Engineer Resume Example

“Big data engineer with 6 years designing distributed data processing systems at petabyte scale. Expert in Spark, Hadoop, and cloud-native big data platforms with experience building batch and streaming architectures for real-time analytics and machine learning pipelines.”

• Built a petabyte-scale data lake on S3 with Delta Lake. Ingests 20TB+ daily from 100+ sources with ACID transactions
• Designed a real-time streaming pipeline using Kafka and Flink. Processes 1M+ events per second for fraud detection with sub-second latency
• Tuned Spark jobs to cut cluster runtime by 55% - fixed partition skew, added broadcast joins, and turned on adaptive query execution
• Migrated 500+ Hive jobs to Spark on Databricks. Processing speed improved 10x and compute costs dropped 35%
• Implemented a lakehouse architecture that handles both batch and streaming analytics. Eliminated the need for a separate data warehouse
• Responsible for managing the Databricks workspace for 30+ data engineers and scientists. Handled cluster policies and access control
• Worked with the ML team to build feature pipelines that feed training data into their models on a daily schedule
• Wrote data quality checks that run after every major pipeline stage. Catches issues before bad data reaches downstream consumers
• Maintained Terraform configs for all data infrastructure including EMR clusters, S3 buckets, and IAM roles

Include these keywords in your resume to pass Applicant Tracking Systems.

• Databricks Certified Data Engineer Professional
• Cloudera Certified Professional