Is anyone looking at wrapping zstandard compression for Julia?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Is anyone looking at wrapping zstandard compression for Julia?

Douglas Bates
See www.zstd.net and github.com/facebook/zstd

If no one has embarked on wrapping this code I could give it a try.
Reply | Threaded
Open this post in threaded view
|

Re: Is anyone looking at wrapping zstandard compression for Julia?

Jacob Quinn
I know there was an effort to start; not sure how far they've gotten: https://github.com/ararslan/ZStd.jl

On Wed, Sep 14, 2016 at 1:44 PM, Douglas Bates <[hidden email]> wrote:
See www.zstd.net and github.com/facebook/zstd

If no one has embarked on wrapping this code I could give it a try.

Reply | Threaded
Open this post in threaded view
|

Re: Is anyone looking at wrapping zstandard compression for Julia?

Alex Arslan
In reply to this post by Douglas Bates
As Jacob noted, I have indeed started an implementation. I've been trying to get it running on all platforms before I get to far into the code, and I've been hung up on getting the 32-bit Windows DLL to work. (I cross-compiled it from my Mac using i686-w64-mingw32-gcc, but I guess that disables sjlj exceptions, which seems to be making the DLL unrecognizable to Julia or BinDeps or something.)

But anyway, I've invited you to be a collaborator on the repo, Doug. And of course anyone reading this is welcome to contribute as well!

Regards,
Alex

On Wednesday, September 14, 2016 at 12:44:07 PM UTC-7, Douglas Bates wrote:
See <a href="http://www.zstd.net" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwww.zstd.net\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG9s2DL3QeHSnREB-BH1aWJO1Bm2g&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwww.zstd.net\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG9s2DL3QeHSnREB-BH1aWJO1Bm2g&#39;;return true;">www.zstd.net and <a href="http://github.com/facebook/zstd" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fgithub.com%2Ffacebook%2Fzstd\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGzbuMTNT2HokuObTu0ZDrencgTWA&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fgithub.com%2Ffacebook%2Fzstd\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGzbuMTNT2HokuObTu0ZDrencgTWA&#39;;return true;">github.com/facebook/zstd

If no one has embarked on wrapping this code I could give it a try.
Reply | Threaded
Open this post in threaded view
|

Re: Is anyone looking at wrapping zstandard compression for Julia?

Robert Feldt
In reply to this post by Douglas Bates
zstd compressor is included in Blosc ( https://github.com/Blosc/c-blosc ) so could quite easily be added to Blosc.jl but see 

https://github.com/stevengj/Blosc.jl/issues/3

Cheers,

Robert

Den onsdag 14 september 2016 kl. 21:44:07 UTC+2 skrev Douglas Bates:
See <a href="http://www.zstd.net" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwww.zstd.net\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG9s2DL3QeHSnREB-BH1aWJO1Bm2g&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fwww.zstd.net\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNG9s2DL3QeHSnREB-BH1aWJO1Bm2g&#39;;return true;">www.zstd.net and <a href="http://github.com/facebook/zstd" target="_blank" rel="nofollow" onmousedown="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fgithub.com%2Ffacebook%2Fzstd\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGzbuMTNT2HokuObTu0ZDrencgTWA&#39;;return true;" onclick="this.href=&#39;http://www.google.com/url?q\x3dhttp%3A%2F%2Fgithub.com%2Ffacebook%2Fzstd\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGzbuMTNT2HokuObTu0ZDrencgTWA&#39;;return true;">github.com/facebook/zstd

If no one has embarked on wrapping this code I could give it a try.