Data Engineer

Data Engineer

Key Responsibilities:

●       Data Architecture

○       Provide and partner with developers to create general data architecture in support of a website and mobile application.

○       Implement and enforce data security best practices across pipelines and infrastructure, including vulnerability assessment, dependency patching, and compliance with data protection standards.

○       Work with developers to ensure data quality assurance and implement data validation and cleansing processes to maintain data accuracy and consistency.

○       Work with developers to ensure proper data lineage to understand the flow and transformation of data.

○       Work with developers to implement data quality and integrity

■   Data Validation and Cleansing:  Implement robust data validation and cleansing processes to ensure data accuracy and consistency.

■   Data Profiling:  Use data profiling techniques to understand data characteristics and identify potential issues.

■   Data Metadata:  Maintain comprehensive data metadata to provide context and facilitate data discovery.

●       Data Engineering, Operations & Transformation:

○       Collaborate cross-functionally with the analytics team, architects, developers, product owners, and business stakeholders to understand data requirements and deliver scalable solutions that enable actionable insights.

○       Write clear documentation for data processes, code, and reports to ensure transparency and reproducibility.

○       Design and implement ETL (Extract, Transform, Load) processes to clean, organize, and prepare data for analysis.

○       Develop and optimize complex data transformation workflows using SQL,  Python, Estuary, dbt and other transformation tools.

○       Work with large datasets to ensure data accuracy, consistency, and integrity.

○       Level 3 support for on-call data issues related to data transformation failures or critical data alerts.

●       Data Development (PostgreSQL, Mongo, Dynamo, & MSSQL):

○       Develop and maintain MULTIPLE database platforms/products, including the design of tables, views, and indexes for optimized query performance.

○       Write and support AWS Lambda functions

○       Write efficient SQL queries for data extraction, aggregation, and transformation.

○       Troubleshoot and resolve database performance issues.

Qualifications:

●       Technical Skills:

○       Generalized data development and design experience with the ability to assist developers with proper architecture.

○       Strong proficiency with PostgreSQL, MSSQL, Mongo, and Dynamo for data design, management, and optimization.

○       Strong proficiency with AWS Lambda and RDS services.

○       Moderate to strong proficiency with Python for data development, advanced analytics, pipeline development and transformation tasks.

○       Experience with creating data insights and predictive analytics using Python, AWS Sagemaker and/or R.

○       Moderate to strong proficiency in data modeling, ETL pipelines, and data integration.

●       Experience:

○       3+ years of experience working in a data engineering role.

○       1+ years of experience with data architecture and design

○       Proven experience in data transformation and creating scalable data workflows.

○       Experience working with large datasets and high-performance databases.

○       Familiarity with AWS Sagemaker and data science development best practices.

○       Familiarity with cloud data platforms (AWS, GCP, Azure).

○       Experience using GitHub and a CI/CD pipeline

○       Experience with other data visualization tools (e.g., Tableau, Power BI).

○       Knowledge of version control systems (e.g., Git).

●       Soft Skills:

○       Strong problem-solving skills and the ability to work independently and in a team.

○       Good communication skills, with the ability to explain technical concepts to non-technical stakeholders.

The first 90 days with uShip:

First 30 Days: Onboarding & Internal Knowledge Absorption

●      Gain a deep understanding of company data, systems, and workflows.

●      Establish relationships with key stakeholders & development teams.

●      Set up your development environment and familiarize yourself with tools.

●      Understand the current data architecture footprint, tools and system integration points.

Days 31-60: Hands-on Execution & Process Improvement

●      Take ownership of small data engineering tasks.

●      Create new ETL pipelines and data transformation workflows.

●      Create data sets in support of dashboard creation in Metabase.

Days 61-90: Full Ownership & Strategic Impact

●      Take full ownership of key data engineering and analytics workflows.

●      Identify and implement process improvements for data scalability and performance.

●      Drive cross-functional collaboration and proactive insights generation.

Location:  Austin, TX 78701, remote or hybrid optional team environment

Salary:  $120-140k base salary ($140-160k estimated total comp)

  *Unfortunately, we are unable to employ remote employees in the following locations:  New York City, Massachusetts, Montana, Hawaii, Alaska, California, and anywhere outside of the U.S.
  *We are unable to transfer or sponsor visas, this includes OPT and H1b 
  *No agencies or independent contractors please

 

Why uShip?

uShip offers big-company benefits in a small-ish sized company because we really value and are committed to our people. There are even some extras that will surprise you.

• Remote or hybrid work options
• Monthly Wellness Reimbursements
• Home office Reimbursements
• Company paid meal delivery pass
• 100% Paid Health and Dental available
• 401(k) matching, no vesting
• Stock Options
• Pet Insurance
• Dog-friendly downtown office
• So much more!

Company Overview

uShip is the world’s first and largest shipping marketplace, making it quicker, easier, and more affordable to ship large or bulky items. Consumers and businesses can compare and book bids from hundreds of thousands of customer-reviewed transportation service providers, ranging from independent owner-operators to the largest freight carriers and brokers. From cars to cranes and furniture to freight, our straightforward and transparent platform helps people, businesses, e-commerce sellers, and multinational logistics companies ship with greater speed and efficiency. Customers save money and service providers make money using their empty cargo space – everyone wins!

We welcome diversity in all its forms, and believe we’re better collaborators, strategizers, and thinkers because of it. uShip is an equal opportunity employer. We are inspired to find candidates who embody our Core Values. uShip prohibits discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, gender identity, age, parental status, national origin, disability, or veteran status. We celebrate our differences and are committed to creating an inclusive environment for all employees.