ETL Integration Engineer
Role: Python Integration Engineer (Python, SQL, DWH, SSIS)
Location: Charlotte NC (hybrid)
Duration: 6+ Months
Job Description:
ETL Integration Engineer
- Responsible for extracting and copying business data and loading it into a data warehousing environment that they have designed.
- Need to have both design and programming skills as they are also responsible for testing the performance of the system and troubleshooting any problems before it goes live
- Must have extensive knowledge of coding languages, especially python and warehouse architecture and be able to clearly communicate your ideas to the company.
- Must have experience creating highly efficient and customized warehouse environments that perfectly suits the data storage needs of the company.
- Need strong in Python libraries mainly NumPy and Pandas
Essential Responsibilities/Duties:
- Leads the design of the logical data model and implements the physical database structure and constructs and implements operational data stores and data marts.
- Consulting with data management teams to get a big-picture idea of the company's data storage needs.
- Presenting the company with warehousing options based on their storage needs.
- Designing and coding the data warehousing system to desired company specifications.
- Develop/Maintain confluence pages to track all data warehouse implementations and specifications
- Conducting preliminary testing of the warehousing environment before data is extracted.
- Develops logical and physical data flow models for ETL applications.
- Translates data access, transformation, and movement requirements into functional requirements and mapping designs.
- Extracting company data and transferring it into the new warehousing environment.
- Testing the new storage system once all the data has been transferred.
- Develop/Maintain data mapping confluence pages based on data hosted by company warehouse
- Troubleshooting any issues that may arise.
- Providing maintenance support.
Skills:
- 5+ years - Enterprise Data Management
- 5+ years - SQL Server based development of large datasets
- 4+ years with Data Warehouse Architecture, Snowflake experience preferred
- 3+ years' experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints
- 5+ years Python coding experience
- PL/SQL Server development experience
- Experience with Azure Data Factory and Azure Databricks
- Dimensional modeling experience
- ETL tools experience, such as SSIS
- Extensive knowledge of coding languages, including Python, Java, XML, and SQL.
- Proficiency in warehousing architecture techniques, including MOLAP, ROLAP, ODS, DM, OLTP, OLAP, Dimensions, Facts, Data modeling and EDW.
- Proven work experience as an ETL developer.
- Strong project management skills.
- Ability to analyze a company's big-picture data needs.
- Clear communication skills.
- Ability to troubleshoot and solve complex technical problems.
- Modeling tools experience, such as Toad Data Modeler, Erwin, and Embarcadero
- Hands-on experience with Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing
