Opens LinkedIn
- Employment type
- Full-time
- Experience level
- Senior · 5+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Associate
- Application method
- Apply on LinkedIn (LinkedIn sign-in required)
Job summary
Design, develop, and maintain Python software, including custom rules frameworks and PySpark programs for data analysis. Gather data from HBase, apply business transformations using Spark DataFrames or RDDs, perform Hive-based read/write operations, and develop and optimize backend services and APIs.
Job details
Hi Professionals, Greetings from Vegaintellisoft Role : Python Developer Location : Mississauga, ON, Canada (Onsite) Duration : Full time Experience : 8+ years needed Responsibilities: · Design, develop, and maintain software solutions using Python. · Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine). · Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations.. · Develop back-end services, APIs, and integrate databases. · Optimize applications for performance, security, and maintainability. · Troubleshoot and resolve software defects and issues. Required Skills: · Strong proficiency in Python and Spark.
What you’ll do
Design, develop, and maintain Python software, including custom rules frameworks and PySpark programs for data analysis. Gather data from HBase, apply business transformations using Spark DataFrames or RDDs, perform Hive-based read/write operations, and develop and optimize backend services and APIs.
Requirements
Requires 8 or more years of experience and strong proficiency in Python and Spark. The role also involves PySpark, HBase, Hive, data analysis, backend services, APIs, and database integration.
Listed skills
- Data analysis · Preferred
- Troubleshooting · Preferred
- Python · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- Apache Spark
- PySpark
- Data Analysis
- Custom Framework Development
- Rules Engine Development
- HBase
- Apache Hive
- Spark DataFrames
- Spark RDDs
- Business Transformations
- Backend Services
- API Development
- Database Integration
- Performance Optimization
- Troubleshooting
Job areas
- Software
- Technology
- Data & Analytics