Lead Databricks Engineer
AIT Global, Inc.
- Job
- 28352
- Posted
- Location
- Chicago, IL
- Work type
- Contract
- Tax terms
- W2, C2C, 1099
- Experience
- Experience open
- Openings
- 1 opening
Opens your email app with a message to the employer, its subject naming this job. Attach your resume and send it from your own email.
Skills
- SQL
- SQL Server
- Python
- PySpark
- Databricks
- Delta Lake
- ETL
- Data Modeling
- Azure
About the job
Job Title: Lead Databricks Engineer
Location: Irving, TX OR Chicago, IL - Hybrid
Qualifications:
- 8+ years of professional data engineering experience, with proven technical leadership.
- Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
- Deep experience with Databricks WHEN SUBMITTING let me know what feature/components of Databricks they have worked with
- Hands-on experience with ETL tools such as Azure Data Factory.
- Experience working with API calls and Ingesting data from external source systems
- Experience with SQL, Python and PySpark
- Experience with building dynamic and scalable solutions for data ingestion and curation
- Experience in data engineering and MS SQL Server and T-SQL development.
- Strong understanding of data lake/delta lake architectures and modern data pipelines.
- Strong understanding of medallion architectures and design patterns.
- Strong understanding of data modeling techniques.
- Experience handling large-scale data volumes, Big data tools and Iac