Ubiminds: Scale Distributed Engineering Teams In Brazil

Data Engineer at Paper (Python, Bash, SQL) (180)

Info on the Data Engineer Role

Ubiminds is looking for a Senior Data Engineer to join our client’s growing R&D and analytics team, supporting data analysts and data scientists on data initiatives, ensuring that their data delivery architecture is optimized and consistent throughout ongoing projects.

Driven by the mission to democratize education, Paper is the leader in personalized learning. Partnering with innovative schools and school districts, Paper helps deliver true educational equity through their category-leading Educational Support System (ESS) that offers virtual access to 24/7 tutors and essay reviewers.

Join a company partnered with over 700 schools, supporting over 750,000 students to reach their academic potential, independent of socioeconomic status, geography, language, or other barriers - what a great mission!

Perks and Benefits

As Data Engineer @Ubiminds, you:

  • Are placed in a product-based company, with the same treatment as their full-time employees.
  • Have our full back-office support, from career guidance to HR and concierge services.
  • Choose to work remotely or at our office – we are a distributed team, after all.
  • Get your own MacBook (none of that BYOD stuff here).
  • Have access to opportunities for growth with other amazing technology professionals, counting with tech talks, chapter meetings, and even remote happy hours for tons of fun!
  • Improve your English through free lessons with a native American teacher - get to the next level on your communication skills!
  • Have the chance to meet up with us every so often at our HQ in Florianopolis
  • Receive financial support to take part in conferences, meetups, and relevant events

Challenge

The Senior Data Engineer will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of designing and optimizing their data architecture to support the company's growth.

What you’ll do as a Data Engineer at Ubiminds

  • Create and maintain a product API for data requests
  • Design data models, utilizing patterns such as star schemas, data vault, 3NF, temporal, and flat dimensional/fact as appropriate
  • Develop of micro-batch/real-time idempotent data pipelines
  • Create CI/CD pipelines to automate the deployment of data pipelines to production
  • Participate in architecture reviews and provide input on the cloud data pipeline tools
  • Ensure the code is versioned, data quality checks exist in each stage of the pipeline
  • Collaborate with CloudOps on the creation of accounts, roles, resource provisioning, and continuous deployment of the data pipeline.
  • Develop metrics to track/monitor the pipeline and notify/respond in case of anomalies
  • Able to migrate and integrate data from AWS RDS, Salesforce, etc. to BigQuery
  • Able to take backup, restore and upgrade databases to major version

In order to succeed in this position, you will need

Cultural add

  • People First. We are all about people!
  • Challenge yourself. There’s always room for improvement and continuous improvement is in our essence.
  • Make it happen. Be ready to take challenges as they come. It’s all about attitude and commitment.
  • We’re in this together. We work as a team, we thrive as a team and we evolve as a team.
  • Averaging on awesome. We work hard to deliver high-quality services and look forward to exceeding expectations.
  • Keep it real. We promise you honesty, transparency, and openness, regardless of the situation.

Mandatory skills

  • Vast experience in a data engineering role
  • Proficiency with SQL, Python/Pandas, Bash, and columnar databases/cloud data warehouse
  • Strong analytic skills related to working with semi/unstructured datasets.
  • Experience building processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Working experience with ownership of the end-to-end data pipeline with big data workloads and serverless/distributed processing using tools/services similar to PubSub, Dataflow, BigQuery, and DBT.
  • A degree in Computer Science, Statistics, Informatics, Information Systems or quantitative field.
  • Able to explain concepts such as compute layer, storage, nodes, concurrency, cache, optimizer, authentication, parallelism, materialized views, execution statistics, and query plan

Nice to have

  • Experience with Google cloud services and stream-processing systems is a plus
  • Experience with data orchestration/workflow management tools: Azkaban, Luigi, Airflow, Prefect, etc.

Non-technical skills

  • Strong communication and presentation skills

Job summary.

  • start date 21/12/2021
  • end date 21/01/2021
  • timezone Eastern Standard Time (GMT-4)

Skills

bash python sql

Apply

Ubiminds © 2020. All rights reserved.
crossmenu