Data Engineer Job at Stellar IT Solutions LLC, Hopkins, MN

YWtiMTBnN01EeGN1YWtQT3VPc0pVSTh3M0E9PQ==
  • Stellar IT Solutions LLC
  • Hopkins, MN

Job Description

Job Title: Data Engineer

Interview: Virtual

Job Duration: 6 Months

Job Location: Hopkins MN



Job Description:
We are seeking a Data Engineer with expertise in building scalable data pipelines and managing big data solutions in Azure. This role involves collaborating with crossfunctional teams to design develop and optimize data workflows while ensuring alignment with industry standards and best practices.

Key Responsibilities:

  • Design and develop data pipelines in Azure using Spark technologies to process and manage large datasets.
  • Build and maintain Zafin and AC360 data pipelines to ensure seamless integration and highperformance data processing.
  • Develop Airflow DAGs for automated scheduling and orchestration of workflows.
  • Collaborate with product owners business stakeholders and engineering teams to gather and define technical requirements.
  • Apply a DevOps mindset to production systems incorporating automation active alerting and selfhealing techniques.
  • Optimize big data solutions to ensure scalability reliability and efficiency .
  • Perform peer code reviews and define best engineering practices to maintain highquality deliverables.
  • Document technical designs workflows and engineering artifacts to support team knowledge sharing and maintenance.
  • Partner with key stakeholders to ensure endtoend testing and smooth deployment of software products.

Qualifications:

  • Big Data Expertise : 10 years of experience managing largescale datasets and distributed systems.
  • Spark (Scala SQL Py) : 5 years of handson experience.
  • Cloud Technologies : 4 years of experience with Azure Kubernetes and PostGres.
  • DevOps and CI/CD : Proficiency in Maven Git Jenkins Docker and Kubernetes.
  • Programming Skills : Strong knowledge of Python Java and GoLang (3 years).
  • Airflow and Elastic Stack : 3 years of experience with tools like Kibana and ELK.
  • Soft Skills : Excellent verbal and written communication skills (10 years).
  • Analytical and ProblemSolving Skills : Strong technical and logical capabilities (10 years).

Preferred Skills:

  • Experience with Spark Scala Python and the Azure technology stack.
  • Familiarity with microservicesbased applications and best practices for data engineering.

Job Tags

Remote job,

Similar Jobs

The Roman Catholic Diocese of Phoenix

Funeral Associate Job at The Roman Catholic Diocese of Phoenix

Holy Cross Catholic Cemetery and Funeral Home is seeking part-time Funeral Service Associates to assist with its funeral ministry at our Holy Cross Cemetery and Funeral Home in Avondale, AZ. This individual will assist funeral directors on services; drive company vehicles... 

Patterson Nissan Longview

Sales Professional - Truck Stop Job at Patterson Nissan Longview

 ...Patterson Truck Stop is a used car dealership in Longview, TX where everyone is crazy about trucks. We have lifted trucks, full-size trucks, and affordable small trucks, too. From Ford F-150s to Toyota Tacomas, drivers can buy trucks of every make and model in one convenient... 

HealthPlus Staffing

*Physician Assistant / Nurse Practitioner for Urgent Care in Roxborough, PA (Philadelphia) Job at HealthPlus Staffing

 ...Our client is a rapidly expanding Urgent Care group with several locations in Philadelphia, PA. The physician will be responsible for working 12 shifts per month, which would include a combination of 12hr and 8hr shifts. The ideal candidate has experience in Urgent Care... 

PatientIQ

Remote Marketing Communications Manager Job at PatientIQ

 ...As Manager of Marketing Communications, youll be a key marketing leader responsible for developing, managing, and executing exceptional and effective marketing campaigns and internal/external communication initiatives. Youll lead junior marketing communications team... 

Anera

Gift Officer - California (Remote) Job at Anera

 ...degree in a related field, or an equivalent combination of education and experience. ~3-5 year of experience with fundraising, nonprofit leadership, sales, customer service, or external relations. ~ Demonstrated success with portfolio, prospect, or customer relationship...