Commit Graph

5506 Commits

Author SHA1 Message Date
Yann Collet
33f7709c71 fileio: changed parameter type from ptr to plain structure
safer : this parameter is read-only,
we don't want original structure to be modified
2018-08-13 13:02:03 -07:00
Yann Collet
09c9cf3f51 simplified rateLimiter
resists better to changing in/out conditions
limits risks of "catching up"
2018-08-13 12:13:47 -07:00
Yann Collet
e11f91b039 remove error message for Ctrl+C 2018-08-13 11:48:25 -07:00
Yann Collet
f3aa510738 rateLimiter does not "catch up" when input speed is slow 2018-08-13 11:38:55 -07:00
Yann Collet
e7a49c6683 introduced command --adapt 2018-08-11 20:48:06 -07:00
Yann Collet
a996b1fd2d fixed rate limited for high speed 2018-08-10 17:39:00 -07:00
Yann Collet
681a382eea added rateLimiter.py, by @felixhandte
this rate limiter avoid the problem of `pv`
which "catch up" after a blocked period
instead of preserving a constant speed cap.
2018-08-10 12:25:52 -07:00
Yann Collet
9d26cb6a75 slow down faster when output speed is limited 2018-08-09 17:44:30 -07:00
Yann Collet
3d7b533f68 Merge branch 'dev' into adapt 2018-08-09 15:57:36 -07:00
Yann Collet
754942cb79 fixed assert() condition 2018-08-09 15:57:19 -07:00
Yann Collet
2dd76037be zstd cli can increase level when input is too slow 2018-08-09 15:51:30 -07:00
Yann Collet
79a35ac20d minor code comments improvements 2018-08-09 15:16:31 -07:00
Yann Collet
601671a06e
Merge pull request #1273 from facebook/zstdgrep
added zstdgrep documentation
2018-08-09 12:35:49 -07:00
Yann Collet
51e71a5ec7 added zstdgrep documentation
presenting `zstdgrep` limit regarding dictionary compression
with workaround recommended by @tobwen (#1268)
2018-08-09 12:28:25 -07:00
Yann Collet
1bc69b9cb5
Merge pull request #1272 from facebook/travisTest
gcc-8 travis test
2018-08-08 14:56:00 -07:00
Yann Collet
48a421c1f0
Merge pull request #1271 from felixhandte/circleci-2.0-config
Migrate Config to CircleCI 2.0
2018-08-08 14:48:51 -07:00
W. Felix Handte
6518745024 Preserve Commented-Out Longer Tests 2018-08-08 14:09:12 -07:00
Yann Collet
d1afd48e44 some errors may only happen when optimizations are enabled 2018-08-08 12:37:08 -07:00
W. Felix Handte
0ede1735b0 Remove Old CircleCI Config 2018-08-08 12:33:21 -07:00
W. Felix Handte
4f5e4fe9ed Fix Path 2018-08-08 12:32:55 -07:00
W. Felix Handte
9deef2c41b Add an Auto-Gen'ed CircleCI 2.0 Config
Built via the cci-config-generator.sh script.
2018-08-08 10:28:22 -07:00
Yann Collet
23ab7875e1 try adding gcc-8 compilation tests 2018-08-08 10:26:54 -07:00
Yann Collet
93750a54a9 try to improve some travis test speed 2018-08-08 10:22:19 -07:00
Yann Collet
0d5813ca01
Merge pull request #1243 from facebook/fix1241
fix #1241
2018-08-08 10:18:02 -07:00
Yann Collet
3c491c8d92
Merge pull request #1269 from felixhandte/fix-fix1241
Fix fix1241: Fix CDict Attachment to Handle CDicts with Non-Zero Starts
2018-08-08 09:25:40 -07:00
W. Felix Handte
2ca7c69167 Fix CDict Attachment to Handle CDicts with Non-Zero Starts
CDicts were previously guaranteed to be generated with `lowLimit=dictLimit=0`.
This is no longer true, and so the old length and index calculations are no
longer valid. This diff fixes them to handle non-zero start indices in CDicts.
2018-08-07 18:14:14 -07:00
Yann Collet
5808027abf Merge branch 'dev' into fix1241 2018-08-03 16:08:33 -07:00
Yann Collet
df09d4318f
Merge pull request #1263 from facebook/travisTest
Fix Makefile on Linux and ZSTD_NOBENCH
2018-08-03 15:57:22 -07:00
Yann Collet
2fdab1629b fix unused variable warning 2018-08-03 08:30:01 -07:00
Yann Collet
ca785c4b20 fix .travis.yml 2018-08-03 07:59:33 -07:00
Yann Collet
5203f01774 fix : zstd cli can be built with build macro ZSTD_NOBENCH
which disables bench.c module
2018-08-03 07:54:29 -07:00
Yann Collet
b002eac69a Merge branch 'dev' into travisTest 2018-08-02 11:53:46 -07:00
Yann Collet
064b8e6785 Merge branch 'travisTest' of github.com:facebook/zstd into travisTest 2018-08-02 11:52:12 -07:00
Yann Collet
5892dd5da4
Merge pull request #1255 from terrelln/norm-fix
[FSE] Fix division by zero
2018-08-02 11:48:56 -07:00
Nick Terrell
dc5a67cb7b Disallow tableLog == srcLog 2018-08-02 11:12:17 -07:00
Jennifer Liu
0acb0abd1e Add non-optimize FASTCOVER (#1260)
* Add non-optimize FASTCOVER

* Minor fix

* Pass param as value instead of pointer
2018-08-01 11:06:16 -07:00
Nick Terrell
1420129fda
Merge pull request #1258 from jennifermliu/fastCover
Use CDict instead of CCtx in analyzeEntropy
2018-07-31 14:31:05 -07:00
Jennifer Liu
f5228f2c44 Refactoring 2018-07-31 13:58:54 -07:00
Jennifer Liu
4e29bc2469 Use CDict instead of CCtx in analyzeEntropy 2018-07-31 10:36:45 -07:00
Nick Terrell
fc685d6b94
Merge pull request #1257 from jennifermliu/fastCover
Increment frequency for every dmer occurence within same sample
2018-07-30 16:03:18 -07:00
Nick Terrell
b9faaa1dc3 [FSE] Add division by zero test 2018-07-30 13:24:09 -07:00
Jennifer Liu
31229e527b Increment frequency for every dmer occurence within same sample instead of at most once per sample 2018-07-30 12:54:22 -07:00
cyan4973
e85b4c56b2 speed up appveyor tests 2018-07-30 17:13:13 +02:00
cyan4973
3f535007e4 fix %zu support under minGW
and relevant test on Appveyor
2018-07-30 16:56:18 +02:00
cyan4973
c738a2c795 ensure appveyor test fails due to formatting error
to catch %zu incompatibility
2018-07-30 16:44:20 +02:00
cyan4973
aade1e5904 Merge branch 'dev' into fix1241 2018-07-30 16:30:35 +02:00
cyan4973
3d4b09a5aa support %zu under mingw 2018-07-30 16:29:20 +02:00
Nick Terrell
92633789f6
Merge pull request #1254 from jennifermliu/fastCover
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
2018-07-27 18:22:52 -07:00
Jennifer Liu
51b109c1b5 Delete old benchmarking result 2018-07-27 17:31:33 -07:00
Nick Terrell
9889bca530 [FSE] Fix division by zero
When the primary normalization method fails, and
`(1 << tableLog) == (maxSymbolValue + 1)`, and every symbol gets assigned
normalized weight 1 or -1 in the first loop, then the next division can
raise `SIGFPE`.
2018-07-27 17:30:03 -07:00