AI Engineer - Irving, TX, Charlotte, NC, or Chandler AZ
mProgen
- Job
- 29048
- Posted
- Location
- Irving, TX
- Work type
- Contract
- Tax terms
- W2, C2C, 1099
- Experience
- Experience open
- Openings
- 1 opening
Opens your email app with a message to the employer, its subject naming this job. Attach your resume and send it from your own email.
Skills
- Kafka
- SQL
- Python
- PySpark
- Spark
- Hadoop
- Airflow
- BigQuery
- AWS
- Azure
About the job
Required Qualifications:
5+ years of experience in data engineering including hands-on experience working with Hadoop and Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, in a highly collaborative team
2+ years of hands-on experience developing data flows using Kafka, Flink, and Spark streaming
3+ years of experience with Data lakehouse architecture and design, including hands-on experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GPC Cloud Storage, BigQuery, Data Proc, Cloud Composer
2+ years working with NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats
Public cloud certifications such as Google Cloud Platform Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics