Yann Collet
80cee8d3fe
faster rebuild of zstd
...
Building the zstd CLI costs time.
Some part of it is incompressible, leading to substantial iteration delay when testing code modifications.
That's mainly because all source files from the library must be rebuilt from source every time.
The main reason we don't build the CLI from library object files
is that we can't just build the object directly in the lib/ directory
(which they would by default)
since they use different compilation flags.
Specifically, the CLI enables multithreading, while the library doesn't (by default).
This is solved in this commit, by generating the object files locally.
Now, the CLI and the library can employ different sets of flags, without tripping over each other.
All library object files are generated directly into programs/ dir.
This works because no 2 source files have the same name.
Now, modifying a file doesn't require to recompile the entire lib, just the modified files.
The recipe is also compatible with `-j` parallel build, leading to large build time reductions on multi-core systems.
2020-10-16 00:01:41 -07:00
Like Ma
cc907770bd
Fix building on AIX 5.1
2020-10-09 18:34:00 +08:00
senhuang42
7259b258d1
Add callsites to zstdcli.c and tests to playTests.sh
2020-10-07 13:47:38 -04:00
senhuang42
93cd9d8a6e
Add hasStdoutOutput setter to fileio.h
2020-10-07 13:44:25 -04:00
senhuang42
dd3dac9ce0
Fixed logic for stdout output
2020-10-07 13:43:27 -04:00
senhuang42
1ebe360d0f
Add new stdoutOutput field
2020-10-07 13:42:34 -04:00
Yann Collet
f7d4943788
Merge pull request #2330 from senhuang42/fix_stdinout_error_messages
...
Improve error messages on console input/output
2020-10-06 15:58:37 -07:00
Yann Collet
83461ce963
Merge pull request #2322 from senhuang42/guard_against_stdin_for_warning_prompts
...
Don't let warning messages consume input from stdin
2020-09-30 08:26:50 -07:00
senhuang42
ce56810a32
Modify error messages on console input/output
2020-09-28 12:15:18 -04:00
senhuang42
02422db841
Fix Stdin typo
2020-09-25 11:51:35 -04:00
Yann Collet
236b98e7de
Merge pull request #2310 from senhuang42/fix_multifile_status_bar
...
Fix multifile status bar and summary - clear out extraneous characters
2020-09-25 07:48:33 -07:00
senhuang42
9f7212a48b
Update unit tests
2020-09-24 16:44:33 -04:00
senhuang42
88f4410390
Add more useful failure message when stdin is an input
2020-09-24 16:29:12 -04:00
senhuang42
93d63eaeb8
Expand UTIL_requireUserConfirmation to include stdin input check
2020-09-24 15:58:06 -04:00
senhuang42
432186cbea
Add FIO_determineHasStdinInput() function and member to fCtx
2020-09-24 15:55:30 -04:00
senhuang42
0e8ac6b995
Add fCtx to FIO_openDstFile()
2020-09-24 15:49:30 -04:00
senhuang42
7aa3da1cd7
Use IS_CONSOLE macro to detect that we're indeed using a console
2020-09-22 14:15:52 -04:00
senhuang42
6b6cc80196
Support .zstd suffix only for decompression
2020-09-18 12:49:51 -04:00
senhuang42
29b8f2eb08
Fix multifile decompression summary
2020-09-16 10:38:13 -04:00
senhuang42
1d5c6fda9f
Add filename truncations to decompression
2020-09-16 10:28:45 -04:00
senhuang42
ab0d332563
Add display clears
2020-09-15 15:53:32 -04:00
senhuang42
cad6bf99af
Add padding to remove previous line's leftovers, and keep the printed line to around the same size
2020-09-15 13:01:46 -04:00
Yann Collet
05622992d5
Merge pull request #2292 from senhuang42/multifile_status_update_fio_refactor
...
Make multifile (de)compression print out a summary
2020-09-14 14:06:26 -07:00
Yann Collet
e583e0be8c
Merge pull request #2299 from senhuang42/env_var_num_threads
...
Allow environment variable to specify number of threads for compression
2020-09-14 14:04:19 -07:00
W. Felix Handte
d46306087b
Enable Dedicated Dict Search in the CLI
2020-09-10 18:51:52 -04:00
senhuang42
a71963c7b8
nbThreads instead of numThreads
2020-09-09 12:40:00 -04:00
senhuang42
243c8dfb41
Add include guards for init_numThreads()
2020-09-08 09:26:16 -04:00
senhuang42
cc29492c5f
Update documentation for environment variable
2020-09-08 08:42:46 -04:00
senhuang42
136a0673f6
Add quick documentation for ZSTD_NUMTHREADS in the code
2020-09-07 18:19:31 -04:00
senhuang42
888c385a49
Change param name to ZSTDCLI_NUMTHREADS_DEFAULT
2020-09-07 18:11:42 -04:00
senhuang42
972e063219
Change default num_threads value
2020-09-07 18:09:48 -04:00
senhuang42
5123496104
Adjust function signatures
2020-09-07 13:13:05 -04:00
senhuang42
28a9dc78c3
Always update bytes status in FIO_ctx_t
2020-09-03 20:23:30 -04:00
senhuang42
60ee0519ca
Remove extraneous FIO_ctx_t functions
2020-09-03 20:22:56 -04:00
senhuang42
48bca10792
Address memory leak in CLI from fCtx
2020-09-03 10:14:04 -04:00
senhuang42
23feaecbe5
Fix FIO_removeMultiFilesWarning conflict
2020-09-03 09:49:13 -04:00
senhuang42
49949f1d51
Merge branch 'dev' into multifile_status_update_fio_refactor
2020-09-03 09:44:47 -04:00
senhuang42
202b2954a2
Remove comma-separated decls
2020-09-03 09:28:40 -04:00
senhuang42
a480b02044
Adjust comments and struct to better reflect FIO_ctx_t
2020-09-03 09:26:30 -04:00
senhuang42
7842f43197
Fix 1 file multifile logic, remove unnecessary variable assignments
2020-09-03 09:22:07 -04:00
senhuang42
dbe5305250
Adjusted extra explanation warning to always pop up if applicable
2020-09-02 08:44:42 -04:00
senhuang42
99039988a5
Fixed newline issue and adjusted wording in comment
2020-09-01 13:18:30 -04:00
senhuang42
3a7d625d6b
Cleanup comments, add function to set FIO_ctx_t.nbFilesProcessed
2020-09-01 12:54:21 -04:00
senhuang42
a03917c751
Fix the logic in printing final status updates
2020-09-01 12:46:06 -04:00
senhuang42
a6414f1247
Integrate refactor into status print for multifiles, adjust logic for printing as needed
2020-09-01 12:34:43 -04:00
senhuang42
565f116a56
Change name to ZSTD_NUMTHREADS
2020-09-01 09:02:23 -04:00
senhuang42
d54566f334
First pass at refactoring and creating new FIO_ctx_t */
2020-08-28 11:01:04 -04:00
senhuang42
01828b27e2
Improve documentation, update man
2020-08-27 17:57:20 -04:00
senhuang42
7e867ad61f
Fix potential memory leak
2020-08-26 18:52:32 -04:00
senhuang42
ef11aadc0c
Fix UTIL_requireUserConfirmation() declaration
2020-08-26 17:20:37 -04:00
