Job Description
Visa not allowed. - CPT EAD
- Stem - OPT
- OPT EAD
- FTE to Subco conversion - 6 months cooling period we need to follow or get approval.
- Atos has stringent compliance and security requirements that all employees are expected to adhere to.
- Inform the candidate that they must not have any other part-time or full-time employment while working with Atos on this assignment.
- Obtain explicit confirmation from the candidate that they understand and are comfortable with these requirements and the expected work arrangement before proceeding further.
Client Name - AMEX
Glow - 3ET0JY
Posman - 134667
Role / Skills - Databricks Engineer
Rate - USD $52
Location - Pheonix - Day 1 Onsite - min 3 days a week.
JD - Confirm / share us the complete JD and lets us know if anything specific:
Databricks Engineer Role Overview We are seeking a highly skilled Databricks Engineer to lead the design, implementation, and optimization of scalable cloud-based data platforms. This role requires deep expertise in Lakehouse architecture, Databricks, Apache Spark, and Delta Lake, along with proven experience delivering end-to-end enterprise data engineering solutions.
Key Responsibilities - Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions.
- Lead implementation of:
- Cloud-based data lakehouse platforms integrating diverse data sources.
- Real-time data processing pipelines for operational and analytical use cases.
- Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL.
- Implement advanced data modeling solutions including 3NF, dimensional modeling, and enterprise data warehousing strategies.
- Design and build incremental data loading frameworks and metadata-driven ingestion pipelines.
- Establish data quality frameworks and governance standards.
- Implement and manage Unity Catalog, including fine-grained security and access controls.
- Leverage Databricks components such as:
- Delta Live Tables
- Autoloader
- Structured Streaming
- Databricks Workflows
- Integration with orchestration tools (e.g., Apache Airflow)
- Drive CI/CD automation, deployment strategies, and DevOps best practices.
- Optimize performance of pipelines, Spark jobs, and compute resources.
- Provide architectural guidance and technical leadership across cross-functional teams.
- Engage with stakeholders and clients to translate business requirements into scalable technical solutions.
Deep expertise in :
- Databricks and cloud-native storage/compute platforms
- Apache Spark (batch & streaming)
- Delta Lake & Lakehouse architecture
- Distributed data processing systems
- Strong hands-on programming skills in Python, PySpark, Scala, and SQL.
Job Tags
Full time, Part time, 3 days per week, 1 day per week