Data Engineer

Hi I hope you are doing well. We have an urgent position listed below. Please send your most recent resume along with the expected rate if you are interested. Job role: Data Engineer Location: Canada Remote Job description: Role Overview • Designs, builds, and maintains data pipelines that feed performance metrics into the Databricks Operational Data Store (ODS). This role maps source systems, develops robust data schemas, and automates integrations across business applications, IT services, and core platforms to enable real-time performance reporting for Apptio Bill of IT and IT performance reporting dashboards delivered via Power BI Core Responsibilities • Data Pipeline Engineering: Develop and execute robust API, MCP (Model Context Protocol), and sFTP data ingestions from core IT and business platforms. • Databricks ODS Architecture: Design, optimize, and maintain data schemas, models, and tables within Databricks using Delta Lake and Medallion architecture (Bronze/Silver/Gold). • Data Mapping & Lineage: Map source system infrastructure to establish clear technical data lineage from raw application logs to the analytics layer. • Workflow Automation: Program and manage automated orchestration schedules using Databricks Workflows, Apache Airflow, or cron-based pipelines. • Performance Reporting Support: Deliver clean, structured, and highly performance data layers optimized for end-user BI dashboard consumption (e.g., Power BI, Tableau). Technical Qualifications • Data Platforms: 3+ years of hands-on experience building production data pipelines in Databricks using PySpark, Scala, or Advanced SQL. • Integration Techniques: Proven expertise developing custom REST API clients, handling sFTP secure transfers via script, and utilizing MCP for contextual data synchronization. • Data Modeling: Strong foundation in data warehouse modeling, schema evolution, and managing operational data stores (ODS). • Domain Knowledge: Familiarity with IT Service Management (ITSM) telemetry data, application performance monitoring (APM) tools, or core platform log schemas is a plus. -- Shailendra Rajak Raas infotek corporation 262 Chapman road, Suite 105A, Newark, DE-19702 Phone no. 302-565-0220, Ext. 145 Email id: [email protected] LinkedIn:linkedin.com/in/shailendra-r-9904ba27b

The role involves designing and maintaining data pipelines that feed performance metrics into the Databricks Operational Data Store. Key tasks include automating integrations across business applications and delivering optimized data layers for Power BI dashboards.

Candidates need over 3 years of experience with Databricks, PySpark, Scala, or SQL, and expertise in REST API and sFTP integrations. Knowledge of data warehouse modeling and ITSM telemetry data is highly preferred.

• Power BIPreferred

Identified from the job description. Confirm important requirements above.

• Databricks
• PySpark
• Scala
• Advanced SQL
• Delta Lake
• Medallion Architecture
• REST API
• sFTP
• Model Context Protocol
• Apache Airflow
• Power BI
• Data Modeling
• Data Pipeline Engineering
• Data Lineage
• Workflow Automation
• ITSM Telemetry

• Data & Analytics
• Technology
• Software
• Engineering
• Consulting

Minimum experience

2+ years

Posting language

English

Working hours

40 hours per week

Seniority

Mid-Senior level

Application method

Direct apply is available