The SAFER FMCSA DOT Crawler collects structured, high-quality data on U.S. motor carriers directly from FMCSA’s public “Company Snapshot” pages. It streamlines large-scale data gathering for transportation analytics, compliance workflows, and lead generation. This repository provides a reliable, filter-driven way to extract consistent DOT records at scale.

Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for SAFER FMCSA DOT Crawler you've just found your team — Let’s Chat. 👆👆

This project automates the extraction of FMCSA carrier information, returning each carrier profile as a structured JSON object. It solves the challenge of manually collecting DOT records by providing a fast, resilient, and filter-friendly crawler. Ideal for logistics companies, insurance providers, data analysts, researchers, and teams building transportation datasets.

• Fetches detailed FMCSA “Company Snapshot” records in bulk.
• Supports DOT range, registration date filters, and fleet attributes.
• Provides optional extended fields such as crash reports and safety ratings.
• Clean, flat JSON output optimized for analytics pipelines.
• Designed for large-scale, long-running extraction tasks.

{
  "DOT_num": "2802023",
  "entity_type": "CARRIER",
  "legal_name": "Example Logistics LLC",
  "dba_name": "Example Trucks",
  "mcs150_date": "09-06-24",
  "mcs150_mileage": "120000",
  "mcs150_mileage_year": "2024",
  "mc_mx_ff_numbers": "MC123456",
  "phone": "5551234567",
  "cell_phone": "5559876543",
  "physical_address": "123 Main St, Springfield, IL, 62701, US",
  "mailing_address": "PO Box 456, Springfield, IL, 62701, US",
  "power_units": 50,
  "drivers": 75,
  "truck_units": 45,
  "bus_units": 0,
  "fleet_size": "45-55",
  "cargo_carried": ["General Freight", "Building Materials"],
  "carrier_operation": ["Interstate"],
  "operation_classification": ["For Hire"],
  "company_officer_1": "John Smith",
  "company_officer_2": "Jane Doe",
  "DUNS_num": "012345678",
  "email": "[email protected]",
  "inspections_us": {
    "driver": "12",
    "vehicle": "8",
    "hazmat": "2",
    "iep": "0"
  }
}

SAFER FMCSA DOT Crawler/
├── src/
│   ├── index.js
│   ├── crawler/
│   │   ├── fetchSnapshot.js
│   │   ├── parseSnapshot.js
│   │   └── filters.js
│   ├── utils/
│   │   ├── formatters.js
│   │   ├── request.js
│   │   └── validation.js
│   ├── outputs/
│   │   └── writer.js
│   └── config/
│       └── settings.example.json
├── data/
│   ├── sample-input.json
│   └── sample-output.json
├── package.json
├── LICENSE
└── README.md

• Logistics sales teams use it to identify carriers in specific regions or fleet sizes so they can build targeted outreach lists.
• Insurance analysts use it to evaluate carrier operations, inspections, and crash data to improve risk scoring.
• Market researchers use it to measure competitor presence and regional fleet distribution.
• Compliance departments use it to monitor carrier safety ratings and regulatory updates.
• Data engineering teams use it to populate transportation datasets for analytics dashboards.

Does this tool support filtering by multiple attributes at once? Currently, the crawler performs best with a primary filter per run, such as a DOT range or registration date. Combining multiple filters may reduce output volume or slow down performance.

Are inactive carriers included in the results? No. Only records marked with active status are returned for consistency and relevancy.

Does the output include cleaned and normalized fields? Yes. Phone numbers contain digits only, dates are normalized, and addresses follow a consistent formatting scheme.

Can I extract crash statistics and safety ratings? Yes, these are available through the optional premium fields.

Primary Metric: Processes an average of 8,000–12,000 carrier snapshots per hour depending on DOT range density. Reliability Metric: Achieves a 98%+ successful retrieval rate during long-running sessions with automated back-off. Efficiency Metric: Maintains low memory usage through streaming output, enabling multi-million-record extractions. Quality Metric: Produces 95%+ field completeness across standard fields due to robust parsing and normalization.

“Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time.” Nathan Pennington Marketer ★★★★★

“Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on.” Eliza SEO Affiliate Expert ★★★★★

“Exceptional results, clear communication, and flawless delivery. Bitbash nailed it.” Syed Digital Strategist ★★★★★