About the role
Role: Data Integrator (Power BI)
Major Responsibilities :
- Design and Develop ETL Processes: Architect and implement ETL workflows to extract data from diverse sources, transform it into a usable format, and load it into a data warehouse or data mart.
- Data Pipeline Management: Manage and maintain the ETL pipelines, ensuring data integrity and consistency. Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend, SnowSQL and SnowPipe) to develop data pipeline solutions to ingest and exploit new and existing data sources.
- Database Design and Management: Design and manage database structures, including tables, views, and indexes, to support ETL processes. Experience designing and developing Enterprise Data Warehouse solutions.
- Data Modeling: Develop and maintain data models to ensure data quality and consistency within the BI system. Proficient writing SQL and Python queries and programming including stored procedures and reverse engineering existing process.
- Data Visualization :Create clear and concise visualizations (charts, graphs, dashboards) to communicate data insights effectively.
- Documentation : ability to create well documented tech specs and user guides of existing dashboards.
- Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of the transformed data.
- Performance Tuning: Optimize ETL processes for performance, scalability, and efficiency.
- Scheduling : Setting up Tidal jobs.
Skills:
- 5+ years - Enterprise Data Management
- Expertise in developing and maintaining Azure data factory pipelines.
- 2+ years of hands-on experience with Databricks.
- 5+ years - SQL Server based development of large datasets
- 3+ years with Data Architecture
- 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints
- 3+ years Python coding experience.
- Proficient with Power BI or other data visualization tools
- Hands-on experience with Snowflake utilities such as SnowSQL and SnowPipe
- Working knowledge of MS Azure configuration items with respect to Snowflake.
- Hands-on experience with Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
- Previous experience contributing to an enterprise-wide Cloud Data Platform migration
- Experience with Cloud based data architectures, messaging, analytics
About Open Systems Technologies
Open Systems Technologies is a tier-one vendor for the world's most competitive financial and technology companies, offering both full-time and contract recruiting services across the country. We offer a positive, entrepreneurial, high performing culture where all employees have the unique opportunity to run a full desk. Our office looks, feels, and operates like a start-up, but with the stability, clientele, and resources that only an industry veteran can provide.
At our core, we are structured to be flexible. With over 30 years of experience, OST has been able to stand the test of time and remains the leading provider of IT staffing solutions in NY due to our forward thinking and adaptability through fluctuating job markets and evolving work cultures.
Open Systems Technologies is an Equal Opportunity Employer. All decisions regarding employment will be made without regard to age, race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, marital status, the presence of any physical or mental disability, or any other status or characteristic protected by federal, state or local law.
About the role
Role: Data Integrator (Power BI)
Major Responsibilities :
- Design and Develop ETL Processes: Architect and implement ETL workflows to extract data from diverse sources, transform it into a usable format, and load it into a data warehouse or data mart.
- Data Pipeline Management: Manage and maintain the ETL pipelines, ensuring data integrity and consistency. Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend, SnowSQL and SnowPipe) to develop data pipeline solutions to ingest and exploit new and existing data sources.
- Database Design and Management: Design and manage database structures, including tables, views, and indexes, to support ETL processes. Experience designing and developing Enterprise Data Warehouse solutions.
- Data Modeling: Develop and maintain data models to ensure data quality and consistency within the BI system. Proficient writing SQL and Python queries and programming including stored procedures and reverse engineering existing process.
- Data Visualization :Create clear and concise visualizations (charts, graphs, dashboards) to communicate data insights effectively.
- Documentation : ability to create well documented tech specs and user guides of existing dashboards.
- Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of the transformed data.
- Performance Tuning: Optimize ETL processes for performance, scalability, and efficiency.
- Scheduling : Setting up Tidal jobs.
Skills:
- 5+ years - Enterprise Data Management
- Expertise in developing and maintaining Azure data factory pipelines.
- 2+ years of hands-on experience with Databricks.
- 5+ years - SQL Server based development of large datasets
- 3+ years with Data Architecture
- 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints
- 3+ years Python coding experience.
- Proficient with Power BI or other data visualization tools
- Hands-on experience with Snowflake utilities such as SnowSQL and SnowPipe
- Working knowledge of MS Azure configuration items with respect to Snowflake.
- Hands-on experience with Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing
- Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
- Previous experience contributing to an enterprise-wide Cloud Data Platform migration
- Experience with Cloud based data architectures, messaging, analytics
About Open Systems Technologies
Open Systems Technologies is a tier-one vendor for the world's most competitive financial and technology companies, offering both full-time and contract recruiting services across the country. We offer a positive, entrepreneurial, high performing culture where all employees have the unique opportunity to run a full desk. Our office looks, feels, and operates like a start-up, but with the stability, clientele, and resources that only an industry veteran can provide.
At our core, we are structured to be flexible. With over 30 years of experience, OST has been able to stand the test of time and remains the leading provider of IT staffing solutions in NY due to our forward thinking and adaptability through fluctuating job markets and evolving work cultures.
Open Systems Technologies is an Equal Opportunity Employer. All decisions regarding employment will be made without regard to age, race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, marital status, the presence of any physical or mental disability, or any other status or characteristic protected by federal, state or local law.