Job Description
Data Automation Engineer
Job Description:
Job Overview:
As a Data Automation Engineer, you will play a crucial role in developing and maintaining automated data processing systems. You will work closely with data analysts, and other stakeholders to design, implement, and optimize data pipelines, ensuring the efficient and accurate flow of data throughout the organization.
What You'll Do:
- Develop and implement automated data pipelines for ingesting, processing, and storing structured and unstructured data.
- Integrate data from various sources in real-time and batch mechanisms and perform transformations to ensure consistency, accuracy, and reliability.
- Implement data quality checks and monitoring mechanisms to identify and address issues proactively.
- Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
- Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing.
- Collaborate with other intelligent data teams.
- Ensure seamless data flow for machine learning and analytics applications.
- Collaborate with other intelligent data teams.
- Ensure seamless data flow for machine learning and analytics applications.
- Implement monitoring systems to track data pipeline performance and identify areas for optimization.
- Continuously optimize data processes for efficiency and scalability.
- Document data processes, system architecture, and codebase for knowledge sharing and future reference.
- Keep documentation up-to-date with any changes or enhancements to the data infrastructure.
- Implement and adhere to data security and compliance standards.
- Collaborate with security teams to ensure data protection and privacy.
You're a Perfect Fit If You Have:
- 1+ years of experience in data engineering, automation, or a related field.
- Strong understanding of data pipelines and data lifecycle management.
- Proficiency in scripting languages like Python, Shell, or similar.
- Experience with data automation tools (Airflow, Luigi, etc.) is a plus.
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills to work effectively across teams.
- Knowledge of cloud platforms (AWS, Azure, GCP) for data processing.
- Knowledge of data warehousing and data quality methodologies.
- Experience with data visualization tools (Tableau, Power BI)
Location:
EG-Banha, Egypt (EI Corniche Street)
Time Type:
Full time
Job Category:
Information Technology
Partner ID
Tier
Arrow Electronics, Inc.
With a global network of suppliers, engineers and manufacturers, Arrow is the shortest distance between what’s possible and what’s practical. We’re helping customers shape the tangible future and build the technology to get us there. From smart cities to satellites, we play a central role in progress that improves the quality of life and makes the benefits of technology more accessible.
We are a Fortune 109 company with 2022 sales of $37.1 billion. Our team includes 22,000 employees worldwide across more than 288 locations. We help the world’s best technology companies think “Five Years Out,” working together to innovate the next big thing after the next big thing.
Working at Arrow
We believe in work that elevates career opportunity. With our perspective of “Five Years Out,” we are a community of continuous learners who guide innovation forward to make technology more globally accessible. Our solutions arise from our culture of innovation, inclusion, collaboration, and honest consideration of one another’s unique viewpoints and experiences. Our diversity empowers us to anticipate and exceed the expectations of our customers. Together, we help our customers see beyond their horizons.
Learn more about Arrow Electronics.
Learn more about Arrow’s commitment to Inclusion and Diversity.