Python Big Data Engineer II
Afiniti
Karachi, Pakistan
6d ago

Who are we?

Afiniti is the world’s leading applied artificial intelligence and advanced analytics provider. Afiniti Enterprise Behavioral Pairing™ uses artificial intelligence to identify subtle and valuable patterns of human interaction in order to pair individuals on the basis of behavior, leading to more successful interactions and measurable increases in enterprise profitability.

Afiniti operates throughout the world, and has measurably driven billions of dollars in incremental value for our clients.

Purpose

Afiniti is creating proprietary data analysis, visualization and monitoring software using cutting-edge technologies. We are looking for multiple exceptional candidates to join our team and help us build the next generation of internal and external products.

Key Responsibilities

  • Queries, analyses, and readies for consumption data from disparate sources such as APIs, databases, or files.
  • Responsible for day to day support of commercial data delivery platforms.
  • Works alongside data scientists to identify new data sources and to optimize / identify features in existing data sources.
  • Constructs jobs and scripts using industry standard toolsets to automate various data querying, loading, aggregating, and reporting tasks.
  • Perform code reviews, help define architecture through constant improvement.
  • Own and research data for one or more geographic markets by understanding gaining an understanding for industry, clients, and available data sets / providers.
  • Work with client and AI teams to better understand the needs of Afiniti clients.
  • Mentors other junior engineers and leads by example.
  • The ideal candidate will have

  • Object-Oriented Design and Patterns
  • Python 3+
  • Linux / Unix scripting
  • MongoDB
  • MySQL and related technologies
  • Strong communication skills primarily English conversations with people located around the globe.
  • Experience with complex data models and complex systems
  • Experience with scraping web apis / sites
  • Docker
  • NodeJS / server side JavaScript
  • Spark, MapReduce, et al
  • Experience with Big Data platforms such as Hadoop
  • Apache Airflow
  • Other NoSQL systems (Cassandra, hbase, redis, etc)
  • Education & Qualifications

  • Degree in Computer Science / Engineering or related disciplines.
  • 3+ years experience in software engineering and or data engineering.
  • Salary & Package

    As well as a competitive base salary dependent on the number of years of experience, we also offer Corporate benefits.

    Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form