About the role
Job Title: Principal Architect Location: 100 % Remote
Job Description
The Role: You are the visionary leader responsible for the future of our D&A ecosystem. You will balance long-range platform strategy with the immediate execution of high-impact technical solutions for critical business challenges.
Key Responsibilities: Platform Roadmap: Define the evolution of the Azure/Databricks platform, ensuring it remains at the cutting edge of industry standards. Innovation & POCs: Evaluate and pilot new technologies (e.g., SODA for data quality, Astronomer for orchestration) to solve emerging enterprise needs. Complex Problem Solving: Architect solutions for business-critical hurdles, such as Databricks workspace segmentation, global data residency restrictions, and multi-tenant scaling. FinOps & Optimization: Lead initiatives to optimize Databricks consumption and cloud spend without sacrificing performance. Enterprise Integration: Design complex integration patterns (CDC, Databricks Asset Bundles) for large-scale systems like Warehouse Management (MAWM, PKMS) and AI products (QEval).
Requirements: 10+ years in Data Architecture, with 5+ years in a Principal/Lead capacity at a large enterprise. Deep mastery of the Azure Data Stack and Databricks (Unity Catalog, Delta Live Tables). Proven track record of leading R&D/POC initiatives and moving them to production.
Not the right fit? Search for Architect jobs in Canada
About DataE2E Technologies
DataE2E is a technology consulting and services company based out of USA and India. We provide end-to-end solutions for developing data pipelines and data products. Our mission is to help organizations optimize their business and unlock disruptive opportunities using data.
Our team has over 15 years of experience delivering large scale solutions to companies from variety of industries such as travel, health insurance, auto insurance, financial services, semi-conductor, etc.
We specialize in following areas:
- Data Engineering
- Master Data Management
- Machine Learning and Data Science
- Data Analytics
- Data Warehousing and Business Intelligence
- Data Governance and Management
- Database operations
Our technical expertise span:
- Software Engineering: Java, Python, Scala
- Data Architecture: data lakes, real-time data products, warehouses and marts, operational data stores, OLTP systems
- Big Data, Distributed data processing
- Cloud based data engineering: AWS & Azure
- Bath processing: Spark, MapReduce, Hive
- Real-time processing: Kafka, Amazon MQ, K-streams, Spark-streams
- NoSql database architecture: Cassandra, ElasticSearch, MongoDb, Couchbase
- RDBMS systems: Oracle, Sql Server, DB2, MySql, Postgres
- Distributed DB systems: Netezza, Teradata
- ETL tools: Talend, DataStage, Informatica, SSIS
- BI tools: Tableau, BusinessObjects, Druid, Snowflake , Power BI
Similar Jobs
About the role
Job Title: Principal Architect Location: 100 % Remote
Job Description
The Role: You are the visionary leader responsible for the future of our D&A ecosystem. You will balance long-range platform strategy with the immediate execution of high-impact technical solutions for critical business challenges.
Key Responsibilities: Platform Roadmap: Define the evolution of the Azure/Databricks platform, ensuring it remains at the cutting edge of industry standards. Innovation & POCs: Evaluate and pilot new technologies (e.g., SODA for data quality, Astronomer for orchestration) to solve emerging enterprise needs. Complex Problem Solving: Architect solutions for business-critical hurdles, such as Databricks workspace segmentation, global data residency restrictions, and multi-tenant scaling. FinOps & Optimization: Lead initiatives to optimize Databricks consumption and cloud spend without sacrificing performance. Enterprise Integration: Design complex integration patterns (CDC, Databricks Asset Bundles) for large-scale systems like Warehouse Management (MAWM, PKMS) and AI products (QEval).
Requirements: 10+ years in Data Architecture, with 5+ years in a Principal/Lead capacity at a large enterprise. Deep mastery of the Azure Data Stack and Databricks (Unity Catalog, Delta Live Tables). Proven track record of leading R&D/POC initiatives and moving them to production.
Not the right fit? Search for Architect jobs in Canada
About DataE2E Technologies
DataE2E is a technology consulting and services company based out of USA and India. We provide end-to-end solutions for developing data pipelines and data products. Our mission is to help organizations optimize their business and unlock disruptive opportunities using data.
Our team has over 15 years of experience delivering large scale solutions to companies from variety of industries such as travel, health insurance, auto insurance, financial services, semi-conductor, etc.
We specialize in following areas:
- Data Engineering
- Master Data Management
- Machine Learning and Data Science
- Data Analytics
- Data Warehousing and Business Intelligence
- Data Governance and Management
- Database operations
Our technical expertise span:
- Software Engineering: Java, Python, Scala
- Data Architecture: data lakes, real-time data products, warehouses and marts, operational data stores, OLTP systems
- Big Data, Distributed data processing
- Cloud based data engineering: AWS & Azure
- Bath processing: Spark, MapReduce, Hive
- Real-time processing: Kafka, Amazon MQ, K-streams, Spark-streams
- NoSql database architecture: Cassandra, ElasticSearch, MongoDb, Couchbase
- RDBMS systems: Oracle, Sql Server, DB2, MySql, Postgres
- Distributed DB systems: Netezza, Teradata
- ETL tools: Talend, DataStage, Informatica, SSIS
- BI tools: Tableau, BusinessObjects, Druid, Snowflake , Power BI