Working at MIT offers opportunities, an environment, a culture - and benefits - that just aren't found together anywhere else. If you're curious, motivated, want to be part of a unique community, and help shape the future - then take a look at this opportunity.
DATA SOFTWARE ENGINEER, AGELAB , Center for Transportation & Logistics , to support naturalistic and simulated advanced driving technology research. Will manage a growing dataset comprised primarily of video and tabular sensor data housed on remote servers and databases. Will be responsible for working with data through various software components of a growing data pipeline including activities; leveraging and expanding existing processing pipelines for the SLURM workload manager hosted on a remote academic computing cluster (MGHPCC) running CentOS 6 and 7; managing secure storage and access for hundreds of terrabytes of data while providing data support for local researchers and remote sponsors; working with an existing PostgreSQL database for storing metadata and design new storage schemas on a per-project basis; maintaining/leveraging existing preprocessing code and synchronization scripts that preparing video and time series data for analysis by researchers; developing/integrating third-party annotation approaches into data processing pipelines to augment and transform data; evaluating and developing new computing resources as needed; implementing backup routines; generating documentation; and other duties as requested.
REQUIRED : bachelor's degree in related field; at least two years' programming experience (may include experience gained as an undergraduate) in a Linux environment using Python and/or C/C++; six months' professional experience writing software or managing data; experience with relational databases (e.g., PostgreSQL) and managing large complex data; meticulous attention to detail; strong problem-solving, time-management, communication, and organization skills; and ability to manage multiple priorities, work as part of a team, quickly learn new software programs/interfaces, and troubleshoot minor technical problems. Experience with data and network security and knowledge of and interest in working with vehicle-based data preferred. Job #17666
Internal Number: 17666
About Massachusetts Institute of Technology (MIT)
The mission of MIT is to advance knowledge and educate students in science, technology and other areas of scholarship that will best serve the nation and the world in the 21st century whether the focus is cancer, energy, economics or literature