Skip to content

FLAC splitting consumes a lot of memory on very large files #625

@gaizaharduz

Description

@gaizaharduz

I occasionally download some very large FLAC files (multiple GBs, 192 kHz/24-bit). I found that when Unpackerr tries to split these, the memory used by the process grows above 50% of my 16 GB memory, and leads to Linux's OOM Killer killing the process.

It's possible to split FLAC files very quickly and without loading them into memory using ffmpeg, since it uses stream copying (i.e. just copies chunks of the data without any re-encoding). However, I saw in the discussion on golift/xtractr#133 that adding ffmpeg as a dependency is controversial.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions