Commit Graph

40 Commits

Author SHA1 Message Date
1341f805b0 [*] Lite clean up/Refactor 2022-08-20 07:53:48 +01:00
57d31e0212 [*] Adjust comedically small compression chunk buffer size. I guess 64k for a compressor isn't so bad. I'm under the impression all compression libs buffer internally such that the external stream buffer does not matter - maybe this is overkill. 2022-08-15 06:16:50 +01:00
fd0c5b51b2 Further Linux support
[+] Begin work on IO futexes for io release on process/thread exit
[+] Linux ::readdir iteration
[+] AuConsole buffering API
[*] Fix sleep as to not get interrupted by signals
[*] Switch the type of FS lock used under Linux
[*] Linux: Use new IPCHandle encoding scheme
[*] Fix undefined behaviour: unintialized timeout values (AuLoop/Linux)
[*] Fix undefined behaviour: ConsoleTTY clear line was called of a color of a random value on stack
[-] Remainings of std dir iterator
[*] Fix pthread_kill (aka send signal to pthread handle) always kills process. This is what you expect bc signal handler inheritance.
[*] Reformat the build Aurora.json file
[+] Added clang warning ignores to the build file
[*] Fix: UNIX need to use STDOUT_FILENO. Was using CRT handle in place of fd by mistake.
[+] Linux implementation for IO yield (AuIO::IOYield() - UNIX::LinuxOverlappedYield())
[*] Fix: Linux async end of stream processing. res 0 = zero bytes consumed. <= was detecting this as an error of code 0. Should succeed with zero bytes.
[+] Linux LoopQueue missing epilogue hook for the IO processor
[*] Various refactors and minor bug fixes
[*] Linux fix: Handle pipe EOS as zero
[*] Linux fix: thread termination via a user signal of 77. Need a force terminate.
[*] IPC handle: fix improper int to bool cast in the header setup within ToString
[*] Linux fix: HWInfo CPU topology regression
[-] Linux fix: remove SIGABRT handler
[*] Missing override in compression, exit, and consoletty headers.
[+] Unix Syslog logger backend
2022-08-02 05:52:57 +01:00
ad4c18abe7 [+] Missing LZ4 compressor
[*] Various compression related bugs under the 1/4th of the AuCompression platform related to compression stream objects. Now all 1/4ths match up.
2022-07-20 21:09:40 +01:00
17b1a738ca [*] Solve a few compiler warnings. Mostly unrealistic u32 <-> u64 casts in element iteration and string operations we can reasonably ignore 2022-06-14 17:12:21 +01:00
77c74f886b [*] Update IStreamReader/Writer interfaces to be backed by an Aurora Interface
[+] Aurora::IO::WriteAll
[*] Improve legacy compression API (pt 2)
2022-05-28 12:18:00 +01:00
25a593cac5 [*] Polyfill legacy compression api into modern io era with IStream[reader/writers] 2022-05-28 10:13:58 +01:00
7a0d9701b5 [*] NT regression and fixes 2022-04-15 19:20:12 +01:00
f9ac6fff72 [*] ECompressionType typo 2022-03-30 15:20:04 +01:00
ff88b7f85d [+] lite sku 2022-03-18 04:30:39 +00:00
6e8bb527e7 [*] Update compression api, made window bits optional 2022-02-19 11:16:25 +00:00
86ce9a9281 [*] Improve default window bit correction 2022-02-19 11:10:49 +00:00
9681450156 [*] Wrap Window bit validation around hasWindowbits check 2022-02-19 10:50:28 +00:00
1479219b04 [*] Fix: new compression subsystem objects weren't being allocated with nothrow 2022-02-18 09:17:58 +00:00
cf70f0d45c [*/+/-] MEGA COMMIT. ~2 weeks compressed.
The intention is to quickly improve and add util apis, enhance functionality given current demands, go back to the build pipeline, finish that, publish runtime tests, and then use what we have to go back to to linux support with a more stable api.

[+] AuMakeSharedArray
[+] Technet ArgvQuote
[+] Grug subsystem (UNIX signal thread async safe ipc + telemetry flusher + log flusher.)
[+] auEndianness -> Endian swap utils
[+] AuGet<N>(...)
[*] AUE_DEFINE conversion for
        ECompresionType, EAnsiColor, EHashType, EStreamError, EHexDump
[+] ConsoleMessage ByteBuffer serialization
[+] CmdLine subsystem for parsing command line arguments and simple switch/flag checks
[*] Split logger from console subsystem
[+] StartupParameters -> A part of a clean up effort under Process
[*] Refactor SysErrors header + get caller hack
[+] Atomic APIs
[+] popcnt
[+] Ring Buffer sink
[+] Added more standard errors
        Catch,
        Submission,
        LockError,
        NoAccess,
        ResourceMissing,
        ResourceLocked,
        MalformedData,
        InSandboxContext,
        ParseError

[+] Added ErrorCategorySet, ErrorCategoryClear, GetStackTrace
[+] IExitSubscriber, ETriggerLevel
[*] Write bias the high performance RWLockImpl read-lock operation operation
[+] ExitHandlerAdd/ExitHandlerRemove (exit subsystem)
[*] Updated API style
        Digests
[+] CpuId::CpuBitCount
[+] GetUserProgramsFolder
[+] GetPackagePath
[*] Split IStreamReader with an inl file
[*] BlobWriter/BlobReader/BlobArbitraryReader can now take shared pointers to bytebuffers. default constructor allocates a new scalable bytebuffer
[+] ICharacterProvider
[+] ICharacterProviderEx
[+] IBufferedCharacterConsumer
[+] ProviderFromSharedString
[+] ProviderFromString
[+] BufferConsumerFromProvider
[*] Parse Subsystem uses character io bufferer
[*] Rewritten NT's high perf semaphore to use userland SRW/ConVars [like mutex, based on generic semaphore]
[+] ByteBuffer::ResetReadPointer
[*] Bug fix bytebuffer base not reset on free and some scaling issues
[+] ProcessMap -> Added kSectionNameStack, kSectionNameFile, kSectionNameHeap for Section
[*] ProcessMap -> Refactor Segment to Section. I was stupid for keeping a type conflict hack API facing
[+] Added 64 *byte* fast RNG seeds
[+] File Advisorys/File Lock Awareness
[+] Added extended IAuroraThread from OS identifier caches for debug purposes
[*] Tweaked how memory is reported on Windows. Better consistency of what values mean across functions.
[*] Broke AuroraUtils/Typedefs out into a separate library
[*] Update build script
[+] Put some more effort into adding detail to the readme before rewriting it, plus, added some media
[*] Improved public API documentation
[*] Bug fix `SetConsoleCtrlHandler`
[+] Locale TimeDateToFileNameISO8601
[+] Console config stdOutShortTime
[*] Begin using internal UTF8/16 decoders when platform support isnt available (instead of stl)
[*] Bug fixes in decoders
[*] Major bug fix, AuMax
[+] RateLimiter
[+] Binary file sink
[+] Log directory sink
[*] Data header usability (more operators)
[+] AuRemoveRange
[+] AuRemove
[+] AuTryRemove
[+] AuTryRemoveRange
[+] auCastUtils
[+] Finish NewLSWin32Source
[+] AuTryFindByTupleN, AuTryRemoveByTupleN
[+] Separated AuRead/Write types, now in auTypeUtils
[+] Added GetPosition/SetPosition to FileWriter
[*] Fix stupid AuMin in place of AuMax in SpawnThread.Unix.Cpp
[*] Refactored Arbitrary readers to SeekingReaders (as in, they could be atomic and/or parallelized, and accept an arbitrary position as a work parameter -> not Seekable, as in, you can simply set the position)
[*] Hack back in the sched deinit
[+] File AIO loop source interop
[+] Begin to prototype a LoopQueue object I had in mind for NT, untested btw
[+] Stub code for networking
[+] Compression BaseStream/IngestableStreamBase
[*] Major: read/write locks now support write-entrant read routines.
[*] Compression subsystem now uses the MemoryView concept
[*] Rewrite the base stream compressions, made them less broken
[*] Update hashing api
[*] WriterTryGoForward and ReaderTryGoForward now revert to the previous relative index instead of panicing
[+] Added new AuByteBuffer apis
    Trim, Pad, WriteFrom, WriteString, [TODO: ReadString]
[+] Added ByteBufferPushReadState
[+] Added ByteBufferPushWriteState
[*] Move from USC-16 to full UTF-16. Win32 can handle full UTF-16.
[*] ELogLevel is now an Aurora enum
[+] Raised arbitrary limit in header to 255, the max filter buffer
[+] Explicit GZip support
[+] Explicit Zip support
[+] Added [some] compressors

et al
2022-02-17 00:11:40 +00:00
81bfa7fba6 [*] Begin truncating mapped types 2022-01-20 16:37:22 +00:00
02aa0dfd13 [*] eradicate AuList<AuUInt8> abuse, switch over to AuByteBuffer 2022-01-20 16:04:53 +00:00
c965d8384f [+] AuStaticPointerCast
[*] More refactoring
2022-01-19 18:53:22 +00:00
7759d38ed0 [*] Exterminate more std:: references 2022-01-19 17:08:13 +00:00
b8fde0bdf0 [*] Refactor and clean up exception and threading API
[-] Deprecated abstract vectors struct
2021-10-24 11:19:47 +01:00
caa983ecad [*] Major change in include convention 2021-09-30 15:57:41 +01:00
60d2c59d6e [+] More crypto copypasta 2021-09-21 02:54:47 +01:00
2c68cf529a [*] Should've ran a clean build :( 2021-09-15 02:14:29 +01:00
510928e62e [*] Linux should not raise int3 unless the binary is a debug one
TODO: investigate registering an int3 signal handler to prevent crashing under internal builds
[*] Amend MemoryViews
[*] Begin shifting towards MemoryView based binary APIs
[*] Fix public RSA key leak
[+] Some clean up and possible bug fixes
2021-09-15 00:56:26 +01:00
7c90933e97 [+] Begin work on block compressors
[*] Bug fixes
2021-09-13 22:13:41 +01:00
97f1ae087e Stability/Bug fixes; wxWidgets, compression 2021-09-07 08:59:56 +01:00
bef72f8e4a More compression work, still requires polish and clean up 2021-09-07 08:37:15 +01:00
eb6a1eaad0 [+] TryResize test for bytebuffer type
[+] Added path in telemetry formats under NT FIO failures
[*] Various bug fixes
2021-09-06 20:04:01 +01:00
329abe97f4 [*] lz4 and buffered stream bug fixes 2021-09-06 16:47:35 +01:00
80d351472a [*] untested possible alternative solution, expose internal buffer size, caller does not manage internal buffer size (yet) 2021-09-06 15:22:17 +01:00
c256406053 [*] Untested bug fix: large compression frames were getting dropped 2021-09-06 14:59:00 +01:00
ffe4bc31fc Major patch [1/2] 2021-09-06 11:58:08 +01:00
8233825353 I messed up 2021-07-12 13:06:21 +01:00
be7b080c56 [ABI Break] LZ4 framesize prefix will now be a 32 bit integer. given the recommended length of a small block is 16KiB or ~ 2^16, it doesn't make sense to use 16bit integers 2021-07-11 18:56:20 +01:00
95a04e0984 LZ4: flip in buffers 2021-07-11 18:38:43 +01:00
7579d70bc1 [*] Actually compiles now :( 2021-07-11 18:26:38 +01:00
3be51018c9 [-] Remove Flush from public compression interface
[+] Improved base block [de]compression objects
2021-07-11 12:36:15 +01:00
955578cf8e [+] LZ4 required some more work 2021-07-11 12:18:33 +01:00
dd06417d04 [*] Starting to fix up rushed block compressors 2021-07-11 11:57:14 +01:00
eb4a495199 Initial Commit 2021-06-27 22:25:29 +01:00