Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> nothing else close to it that I've seen

My understanding is that Oodle generally performs better (less CPU on both ends for any desired compression ratio) than ZStd in pretty much every context,

http://www.radgametools.com/oodle.htm

... assuming you control both compression and decompression and are willing to spend money for it.



I don't see comparisons against any version of Zstandard, much less Zstandard 1.4, there.

(Besides, regardless of the state of benchmarks today, the momentum is clearly with Zstandard, with Facebook, Intel, and the open source community behind it. The basic lossless compression algorithms haven't changed much since the late 1970s. Making compression fast is mostly just a long slog of engineering hurdles, the kind that big companies are very good at doing.)


http://cbloomrants.blogspot.com/2018/06/zstd-is-faster-than-... is versus zstd 1.3.3. There are others too on that blog.

Oodle and zstd are both very impressive, it's a shame the former is not free.


Zstandard uses ANS in some (all?) of its modes, that's very much brand new -- 2014


> regardless of the state of benchmarks today, the momentum is clearly with Zstandard, with Facebook, Intel, and the open source community behind it.

This argument by hand-wave doesn’t match up with demonstrated progress over the past few years.

Irrespective of the skill or insight of its individual engineers, I would be surprised if a schizophrenic hack-it-with-duct-tape kind of engineering culture like Facebook could keep up with a focused and motivated expert like cbloom over the medium term (though I suppose the latter could conceivably at some point lose interest in the domain and switch to building something else).


I've seen this play out before. The history of jemalloc, particularly how it rapidly outpaced virtually every other allocator while under development at Facebook, suggests otherwise. At this point jemalloc is so good that there is little reason other than NIH to use anything else (unless you want an especially hardened allocator for security and are willing to give up some performance). Even Google uses it in Android.

Zstandard is likewise deservedly on track to dominate the lossless compression space.


> At this point jemalloc is so good

Some folks disagree:

> [Ruby's] memory usage only reduces when using jemalloc 3; memory usage is still high when using jemalloc 5. Nobody knows why, so that makes the choice of defaulting to jemalloc very dodgy.

via https://www.joyfulbikeshedding.com/blog/2019-03-29-the-statu...


Zstd is from Facebook, sure, but to be more specific its development is lead by Yann Collet (of LZ4 fame) who is unquestionably a focused and motivated expert.


But it’s not WinZip or WinRAR. This is a product marketed for professional use(r)s. How could it ever become more popular than something you just have?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: