hotskills.tech

About Job

Job brief Opportunity only available for Latam residents Responsabilities Designing and developing scalable, efficient, and reliable data pipelines to extract, transform, and load data from various sources to a target system. Responsible for ingesting data from various sources such as databases, files, APIs, or social media platforms using Python libraries like pandas, NumPy, and requests. Designing and implementing data storage solutions using relational databases like MySQL or PostgreSQL, NoSQL databases like MongoDB or Cassandra, or big data stores like Hadoop or Spark. Working closely with data scientists to understand their requirements and implement data pipelines that meet their needs. Ensuring the security of the data pipeline by implementing access controls, encryption, and authentication mechanisms. Working closely with DevOps teams to ensure smooth deployment of the data pipeline to production environments on Azure. Requirements B2 English Level or higher. • 5 years of experience in a Data Engineering role. • 4 years of experience with Python. Experience with Big Data tools such as Hadoop, Spark, Kafka, among others, is expected. Proven experience with both relational SQL and NoSQL databases, such as PostgreSQL, Cassandra, or MongoDB. Experience with Azure cloud services is a must. Good communication skills What do we offer? Type of contract: Independent Contractor with Venon Solutions LLC Contract duration: Long-term Benefits: 2 weeks of PTO (paid time off) Holidays: from the North American calendar Working hours: Full-time EST, fully committed (flexible hours). job perk: Posted At: 15 hours ago, job perk: Schedule Type: Full-time and Contractor, job perk: Qualifications: No degree mentioned, job perk: Paid Time Off: True