Python Big Data Engineer

Afiniti

Lahore, Pakistan

2d ago

Who are we?

Afiniti is the world’s leading applied artificial intelligence and advanced analytics provider. Afiniti Enterprise Behavioral Pairing™ uses artificial intelligence to identify subtle and valuable patterns of human interaction in order to pair individuals on the basis of behavior, leading to more successful interactions and measurable increases in enterprise profitability.

Afiniti operates throughout the world, and has measurably driven billions of dollars in incremental value for our clients.

Purpose

Afiniti is creating proprietary data analysis, visualization and monitoring software using cutting-edge technologies. We are looking for multiple exceptional candidates to join our team and help us build the next generation of internal and external products.

Key Responsibilities

Queries, analyses, and readies for consumption data from disparate sources such as APIs, databases, or files.

Responsible for day to day support of commercial data delivery platforms.

Works alongside data scientists to identify new data sources and to optimize / identify features in existing data sources.

Constructs jobs and scripts using industry standard toolsets to automate various data querying, loading, aggregating, and reporting tasks.

Perform code reviews, help define architecture through constant improvement.

Own and research data for one or more geographic markets by understanding gaining an understanding for industry, clients, and available data sets / providers.

Work with client and AI teams to better understand the needs of Afiniti clients.

Mentors other junior engineers and leads by example.

The ideal candidate will have

Object-Oriented Design and Patterns

Python 3+

Linux / Unix scripting

MongoDB

MySQL and related technologies

Strong communication skills primarily English conversations with people located around the globe.

Experience with complex data models and complex systems

Experience with scraping web apis / sites

Docker

NodeJS / server side JavaScript

Spark, MapReduce, et al

Experience with Big Data platforms such as Hadoop

Apache Airflow

Other NoSQL systems (Cassandra, hbase, redis, etc)

Education & Qualifications

Degree in Computer Science / Engineering or related disciplines.

3+ years experience in software engineering and or data engineering.

Salary & Package

As well as a competitive base salary dependent on the number of years of experience, we also offer Corporate benefits.

Report this job

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.