Cloud Data Engineer (Remote, Contract)

• We will review your application against our job requirements. We do not employ machine learning technologies during this phase as we believe every human deserves attention from another human. We do not think machines can evaluate your application quite like our seasoned recruiting professionals—every person is unique. We promise to give your candidacy a fair and detailed assessment.
• We may then invite you to submit a video interview for the review of the hiring manager. This video interview is often followed by a test or short project that allows us to determine whether you will be a good fit for the team.
• At this point, we will invite you to interview with our hiring manager and/or the interview team. Please note: We do not conduct interviews via text message, Telegram, etc. and we never hire anyone into our organization without having met you face-to-face (or via Zoom). You will be invited to come to a live meeting or Zoom, where you will meet our INFUSE team.
• From there on, it’s decision time! If you are still excited to join INFUSE and we like you as much, we will have a conversation about your offer. We do not make offers without giving you the opportunity to speak with us live. After all, we consider our team members our family, and we want you to feel comfortable and welcomed.

As a Cloud Data Engineer at INFUSE, you will be responsible for designing, implementing, and maintaining robust ETL processes on AWS to support our data-driven decision-making. You will work closely with our servers, integrate various web platforms, and perform other data manipulations to ensure data is available, accurate, and actionable. This role requires a blend of technical prowess, problem-solving skills, and a deep understanding of cloud technologies.

• ETL Process Development: Design, develop, and maintain ETL processes on AWS to extract, transform, and load data across various platforms.
• Server Management: Collaborate with the infrastructure team to manage and optimize servers used for ETL processes.
• Process Improvement: Continuously update and improve existing ETL processes for better performance, scalability, and reliability.
• Integration: Integrate data from different web platforms and ensure seamless data flow between different sources and systems.
• Data Manipulation: Perform data manipulations, and transformations, and ensure data quality for reporting and analytics.
• Collaboration: Work closely with BI engineers, analysts, and other stakeholders to understand their data needs and provide relevant data solutions.
• Documentation: Create and maintain comprehensive documentation of ETL processes, data flow diagrams, and integration procedures.

• Experience:
  • 3+ years of experience in data engineering with a focus on cloud technologies.
  • Proven experience with AWS services like S3, Redshift, Glue, Lambda, etc.
• Technical Skills:
  • Proficiency in SQL and experience with relational databases.
  • Hands-on experience with ETL tools and frameworks (e.g., Apache Airflow, Talend).
  • Strong scripting skills in Python, SQL, and/or other relevant programming languages.
  • Experience with integration of various web platforms and APIs.
• Soft Skills:
  • Strong analytical and problem-solving skills.
  • Excellent communication and teamwork abilities.
  • Self-motivated and able to work independently with minimal supervision.

• Experience with other cloud platforms (e.g., Azure, Google Cloud).
• Knowledge of big data technologies (e.g., Hadoop, Spark).
• Experience with containerization technologies (e.g., Docker, Kubernetes).

Originally posted on Himalayas