Commit Graph

279 Commits

Author SHA1 Message Date
286ae14a7b [*] Refactor WorkItemHandler EProcessNext -> ETickType
[*] AuAsync aue 1 regression
2022-05-17 00:41:27 +01:00
d0c4d8cb33 Hash API polish
[+] Added IHashStream::Export
[+] Added IHashStream::Import
[+] Added IHashStream::Finalize (versus "deprecated" older api)
[+] Added EHashType eMD4, eRMD128, eRMD160, eRMD256, eRMD320
2022-05-14 21:06:46 +01:00
f182ecd986 [+] Added IOSleep.* files, API: AuIO::WaitFor(ms, waitEntireFrame) 2022-05-13 21:02:19 +01:00
86ac108f11 [*] Move AuIO::WaitMultiple
[+] AuIO::WaitMultiple2
2022-05-13 19:25:29 +01:00
2a09e62add [*] Refactor IAsyncTransaction -> Moved namespace from AuIOFS to AuIO bc other file-like APIs share the same FS implementation. IPC, process, and other namespaces have no reason to return an AuIOFS interface when dealing with pipes. 2022-05-12 09:04:32 +01:00
433154a9c6 [+] explicit EAnsiColor::eWhite and EAnsiColor::eBlack 2022-05-12 08:21:32 +01:00
f29171e329 [*] Clean up SWInfo.hpp 2022-05-12 07:34:19 +01:00
1c7267b9d8 [*] Update how AuAsync handles SysPump - we should really deprecate it. 2022-05-09 19:27:36 +01:00
0a38ffacfa [+] NT: IProcess::AsLoopSource()
[*] NT: Bug fix: our side of the process streams were not marked as FILE_FLAG_OVERLAPPED
[+] CreatePipeEx.NT.cpp
2022-05-05 11:26:21 +01:00
dfc21453ef [+] Add IAsyncTransaction::Reset
[*] Bug fixes: Async.NT.cpp
2022-05-05 11:24:44 +01:00
d5ec986e02 [+] Linux async process stream access API implementation and bug fixes in AuIOFS / Async.Linux.cpp implementation 2022-05-04 20:34:46 +01:00
6de5cbfb95 [+] Linux: Added bSingleshot API to timerfd backend
[*] NT: Added TTY handle static getter optimization alongside a secret setter API
[*] Made ILoopSource virtual
[+] Linux: Added console TTY stubs
[*] Renamed ConsoleTTY.Linux.cpp -> ConsoleTTY.Unix.cpp
[-] Redundant commented out shm_unlink (zero ref condition should unlink, i believe.)
[+] Added IProcess async pipe transaction getter stubs
[+] Added additional userland env lookup variables: XDG_SESSION_DESKTOP, DESKTOP_SESSION
[+] Unix: AuTime::ns2ts
2022-05-04 16:43:23 +01:00
2af66e0f71 [+] Add singleshot timer API flag 2022-05-04 14:00:26 +01:00
9f93b8a0b1 [+] 100 nanosecond resolution ILoopSource timer API (gl getting that res) 2022-05-03 18:42:14 +01:00
97cdbc9f27 [+] Overlapped stdout/in/err processes API 2022-05-03 11:10:04 +01:00
45975e4755 [+] Added console stdin loop source
[*] Fix logger color regression
[*] Fix various issues with console config struct
2022-05-03 07:19:26 +01:00
73173bdaae [+] A small hacky TTY interface API 2022-05-03 05:31:49 +01:00
237d2d070c [+] Initial attempt at parsing Linux VMA space
[*] Refactor old C++ enums into AUE derivative
2022-04-21 00:34:08 +01:00
557fd2b574 [+] export AuParse::Parse[U/S]Int using const char*S as iterators
[*] Formatting/clean up
[*] Crinkling under Process
2022-04-20 14:03:51 +01:00
2005b1d0e1 [*] Stupid comment 2022-04-19 01:40:36 +01:00
7dca8ecd29 [+] LSTimer (NT)
[*] Bug fix stupid mismatching variable usage with similar name in LoopQueue.NT.cpp
2022-04-19 00:51:36 +01:00
371006c04e [+/*] NT IPCPipe, updated interface for bidirectional comms. Introducing linux regression 2022-04-17 13:40:08 +01:00
e387f82f88 [*] Update ILoopQueue header (again) 2022-04-16 16:56:03 +01:00
6f75712d05 [+] ELoopSource: eProcessStdIn/Out 2022-04-16 16:36:44 +01:00
790e879fe4 [*] Update ILoopQueue.hpp documentation 2022-04-16 16:36:13 +01:00
9f2ff9de19 [+] IPC pipes
[*] Fix socket leak under UNIX fallback path
2022-04-15 15:46:07 +01:00
2ce106d8a9 [*] Update LoopQueue semantics. Pending NT port 2022-04-15 12:45:47 +01:00
499aaeedab [+] IPCMutex, IPCSharedMemory
[*] Refactor headers
2022-04-15 11:01:43 +01:00
44839e6234 [+] (Linux only) IPCEvent, IPCSemaphore 2022-04-14 20:40:35 +01:00
37cb35d997 [+] UNIX FD sharing (with Linux optimization and a potentially functional BSD fallback)
[+] IPCHandle
[*] Clean up IO init
2022-04-14 20:39:04 +01:00
415116c891 [+] Linux Async IO 2022-04-13 12:00:35 +01:00
457d263fb0 [+] ILoopSource::WaitOn(u32: timeout)
[+] ms2tv
2022-04-12 22:29:50 +01:00
4617587adb [*] Async file aio API WaitMultiple should return a DWORD and call the callbacks 2022-04-12 20:17:58 +01:00
a3b36ea651 [+] Directory awareness in OPLOCK hack of a watcher to bring NT up to Linux possible quality 2022-04-11 13:54:52 +01:00
3defb1bb14 [+] Linux Watcher
[*] Expand watcher API -> Breaking NT
[*] Reexpand loop queue API -> Breaking NT
[*] Linux CPUInfo clean up
[*] Bug fix: mkdir should set execute flag... because directories are special
[*] Refactor: Cleanup base64
[*] Bug fix: UNIX path normalization
[*] Bug fix: missing O_CREAT flag (au auto-creates)
[*] Normalize line endings
2022-04-10 16:40:49 +01:00
cf219eabaa [+] Initial attempt at an epoll backend
[+] Added comments in nt opener
[*] Fixed rng close
[*] Fixed possible aarch64 crash where unix thread ep function didnt return a value
2022-04-09 16:53:14 +01:00
1c78c18997 [+] Exit::CancelExit()
[*] Treat SIGTERM the same as SIGINT. SIGINT is somewhat of an arachic signal meaning, "hey dumb unix app, fuck the process group, start reading from stdin to listen to the user." Nowadays, this doesn't mean anything other than "hey, a human asked us to terminate from a TTY" - basically the same as SIGTERM, except SIGTERM is more likely to be a scheduled or otherwise expected shutdown event.
2022-04-07 06:22:50 +01:00
7705e32c59 [*] Win32 regression 2022-04-05 14:46:19 +01:00
5a96a71949 [*] Address *some* build issues under Linux. Interim port progress 2022-04-04 08:53:34 +01:00
d37eaf6f30 [*] Regression of empty SysPushErrors (fmt now freaks out at this. we can use this over a nullptr. SSO, string pooling, etc, it'll be fine.) 2022-04-03 00:29:20 +01:00
2b4bb66e0c [+] Possible watcher api 2022-04-02 19:15:59 +01:00
a31136a5d4 [+] MakeTemporary 2022-04-02 19:14:24 +01:00
ce62600e18 [*] Update LS enum 2022-04-02 19:14:14 +01:00
5599da3ab0 [*] Harden exit 2022-04-02 01:48:29 +01:00
a4568be6fa [*] Kill net. Branching... 2022-04-01 04:54:21 +01:00
556c6c37bb [*] Demangle 2022-03-31 21:34:37 +01:00
f717511a10 [+] NT OutputDebugStringW logger sink
[*] Split objects
[*] Consider making ABI object api boilerplate
[*] Refactor STLShims (roxtl)
2022-03-31 01:31:40 +01:00
3e80022f95 [*] Cacheline and cachesize report in CpuInfo 2022-03-30 22:45:10 +01:00
c1976d771b [*] Compiler warning
[*] Disambiguate auContainerUtils
[*] Optimize AuLogXXX / remove alloc
[*] Didn't commit two auROXTL idiom updates (ExceptionWatcher and Logging)
2022-03-30 19:07:15 +01:00
79c2a2ffff [*] Gave the NT loop some attention (much more required) 2022-03-30 18:56:56 +01:00
f9ac6fff72 [*] ECompressionType typo 2022-03-30 15:20:04 +01:00
e7f6f79471 [+] RWLock::DowngradeWriteToRead 2022-03-30 12:32:03 +01:00
947356120b [*] Creasing allocators 2022-03-26 16:18:50 +00:00
55857f4158 [*] Recrinkle posters 2022-03-23 19:40:07 +00:00
3507d9bb33 [+] GetSharedAsyncApp 2022-03-23 16:33:02 +00:00
68bfdd1f8d Update ROXTL
[+] Extended fnv1 apis
[+] AuResult
[+] AuHash
[+] AuEnableHashCodeOnData
2022-03-23 16:03:48 +00:00
ba8602744b [+] Interim and incomplete Unix/Linux buildability 2022-03-22 05:10:40 +00:00
9326891ada [*] Angry updating header noises 2022-03-21 07:20:15 +00:00
9542ec8374 [+] Initial OSThread SetThrottle attempt 2022-03-21 07:16:12 +00:00
0fb514f856 New memory APIs
[+] AuMemory::Cache
[+] AuMemory::SwapLock
[+] AuMemory::Transition

AuROXTL
[+] AuPageRoundUp
[+] AuPageRound
2022-03-21 05:20:19 +00:00
8b4bdbd04b [*] CpuInfo (and others) refactor 2022-03-20 12:51:51 +00:00
2544e557b0 [*] Readd old glue accidentally removed in previous commit 2022-03-20 10:58:58 +00:00
b29f8ebf21 [*] Major fix -> vec wrapper w/o glm accessors were broken
[*] Preemptive linux/clang API fixes
[*] Fix clang equiv MSVC template bug (they're nice enough to throw an error instead of crashing)
2022-03-20 09:56:15 +00:00
db24cb2c5b [*] Fix CpuBitScanForward 2022-03-17 13:07:51 +00:00
672915cd55 [*] Improve CpuId awareness through affinity
[*] Clean up OSThread
[*] Tweak HWInfo/CpuInfo
2022-03-16 18:15:57 +00:00
5213a19362 [*] Additional seething 2022-03-13 23:03:53 +00:00
c5f20ab9cf [+] AuLoop 2022-03-11 20:34:00 +00:00
03bb80239c [*] Reglue async and loop together 2022-03-10 15:41:57 +00:00
a7d0e0a261 [*] remove vtbl (ExtendStlLikeSharedPtr) 2022-03-09 01:55:48 +00:00
01647d3a0d [*] bug fix in bytebuffer typedread 2022-03-09 01:52:55 +00:00
b3c62bc325 [+] option to disable null pointer exceptions
[*] vtable based null pointer exceptions
2022-03-09 01:52:36 +00:00
e1e1da8e1b [*] Update placeholder inline -> auline in SysAssertions 2022-03-04 23:29:27 +00:00
53e33b6fdd [*] Added/fix UTF-16 BE count
[*] Optimize stage builds - Crypto API validation
[*] Clean up
2022-03-04 22:28:25 +00:00
805eae7f3d [+] Added _AU_SAW_WIN32_EARLY for AuLoop::NewLSHandle in AuWin32Utils.hpp
[*] Clean up AuROXTL
2022-02-27 09:11:56 +00:00
dbb42a973e [FIX ME] Temp remove NewLSHandle 2022-02-27 07:33:47 +00:00
e517e278e9 [*] more rng work 2022-02-20 20:59:06 +00:00
188e478033 [+] Improve RNG apis. TODO: more work is needed 2022-02-20 20:49:34 +00:00
3651c22159 [+] AuIOFS::WriteFile should use new memory span 2022-02-20 20:31:18 +00:00
efe0abea90 [+] RngRange
[+] AuRng shorthand
2022-02-20 20:25:39 +00:00
191f5df2a1 [+] AuCmdLine shorthand 2022-02-20 17:34:58 +00:00
7864966478 [+] Minimalistic AuNumericLimits implementation 2022-02-19 17:56:45 +00:00
be7e9271e6 [+] Added casts for pointer types
[*] Nuke more std:: references
2022-02-19 11:43:57 +00:00
6e8bb527e7 [*] Update compression api, made window bits optional 2022-02-19 11:16:25 +00:00
749b8deb8d [*] Updated bit utilities
[*] Updated default string type
[*] Spinlocks can now timeout
[*] Finish RW lock write entrant mode
2022-02-18 17:50:33 +00:00
df1c36bd28 [*] Refactor CpuInfo
[*] class -> struct RSA interface
2022-02-18 10:46:51 +00:00
cf70f0d45c [*/+/-] MEGA COMMIT. ~2 weeks compressed.
The intention is to quickly improve and add util apis, enhance functionality given current demands, go back to the build pipeline, finish that, publish runtime tests, and then use what we have to go back to to linux support with a more stable api.

[+] AuMakeSharedArray
[+] Technet ArgvQuote
[+] Grug subsystem (UNIX signal thread async safe ipc + telemetry flusher + log flusher.)
[+] auEndianness -> Endian swap utils
[+] AuGet<N>(...)
[*] AUE_DEFINE conversion for
        ECompresionType, EAnsiColor, EHashType, EStreamError, EHexDump
[+] ConsoleMessage ByteBuffer serialization
[+] CmdLine subsystem for parsing command line arguments and simple switch/flag checks
[*] Split logger from console subsystem
[+] StartupParameters -> A part of a clean up effort under Process
[*] Refactor SysErrors header + get caller hack
[+] Atomic APIs
[+] popcnt
[+] Ring Buffer sink
[+] Added more standard errors
        Catch,
        Submission,
        LockError,
        NoAccess,
        ResourceMissing,
        ResourceLocked,
        MalformedData,
        InSandboxContext,
        ParseError

[+] Added ErrorCategorySet, ErrorCategoryClear, GetStackTrace
[+] IExitSubscriber, ETriggerLevel
[*] Write bias the high performance RWLockImpl read-lock operation operation
[+] ExitHandlerAdd/ExitHandlerRemove (exit subsystem)
[*] Updated API style
        Digests
[+] CpuId::CpuBitCount
[+] GetUserProgramsFolder
[+] GetPackagePath
[*] Split IStreamReader with an inl file
[*] BlobWriter/BlobReader/BlobArbitraryReader can now take shared pointers to bytebuffers. default constructor allocates a new scalable bytebuffer
[+] ICharacterProvider
[+] ICharacterProviderEx
[+] IBufferedCharacterConsumer
[+] ProviderFromSharedString
[+] ProviderFromString
[+] BufferConsumerFromProvider
[*] Parse Subsystem uses character io bufferer
[*] Rewritten NT's high perf semaphore to use userland SRW/ConVars [like mutex, based on generic semaphore]
[+] ByteBuffer::ResetReadPointer
[*] Bug fix bytebuffer base not reset on free and some scaling issues
[+] ProcessMap -> Added kSectionNameStack, kSectionNameFile, kSectionNameHeap for Section
[*] ProcessMap -> Refactor Segment to Section. I was stupid for keeping a type conflict hack API facing
[+] Added 64 *byte* fast RNG seeds
[+] File Advisorys/File Lock Awareness
[+] Added extended IAuroraThread from OS identifier caches for debug purposes
[*] Tweaked how memory is reported on Windows. Better consistency of what values mean across functions.
[*] Broke AuroraUtils/Typedefs out into a separate library
[*] Update build script
[+] Put some more effort into adding detail to the readme before rewriting it, plus, added some media
[*] Improved public API documentation
[*] Bug fix `SetConsoleCtrlHandler`
[+] Locale TimeDateToFileNameISO8601
[+] Console config stdOutShortTime
[*] Begin using internal UTF8/16 decoders when platform support isnt available (instead of stl)
[*] Bug fixes in decoders
[*] Major bug fix, AuMax
[+] RateLimiter
[+] Binary file sink
[+] Log directory sink
[*] Data header usability (more operators)
[+] AuRemoveRange
[+] AuRemove
[+] AuTryRemove
[+] AuTryRemoveRange
[+] auCastUtils
[+] Finish NewLSWin32Source
[+] AuTryFindByTupleN, AuTryRemoveByTupleN
[+] Separated AuRead/Write types, now in auTypeUtils
[+] Added GetPosition/SetPosition to FileWriter
[*] Fix stupid AuMin in place of AuMax in SpawnThread.Unix.Cpp
[*] Refactored Arbitrary readers to SeekingReaders (as in, they could be atomic and/or parallelized, and accept an arbitrary position as a work parameter -> not Seekable, as in, you can simply set the position)
[*] Hack back in the sched deinit
[+] File AIO loop source interop
[+] Begin to prototype a LoopQueue object I had in mind for NT, untested btw
[+] Stub code for networking
[+] Compression BaseStream/IngestableStreamBase
[*] Major: read/write locks now support write-entrant read routines.
[*] Compression subsystem now uses the MemoryView concept
[*] Rewrite the base stream compressions, made them less broken
[*] Update hashing api
[*] WriterTryGoForward and ReaderTryGoForward now revert to the previous relative index instead of panicing
[+] Added new AuByteBuffer apis
    Trim, Pad, WriteFrom, WriteString, [TODO: ReadString]
[+] Added ByteBufferPushReadState
[+] Added ByteBufferPushWriteState
[*] Move from USC-16 to full UTF-16. Win32 can handle full UTF-16.
[*] ELogLevel is now an Aurora enum
[+] Raised arbitrary limit in header to 255, the max filter buffer
[+] Explicit GZip support
[+] Explicit Zip support
[+] Added [some] compressors

et al
2022-02-17 00:11:40 +00:00
19ebdf3761 Preparing for initial WSA network POC rewrite, not porting gen1 code. Linux support is way behind. Will work on it soon.
[*] Minor refactors
[*] Begin refactoring the Processes subsystem
[*] Added empty files ready to move the gross c++ functional callback in the parse subsystem to a dedicated interface w/ utils
[*] Broke out Win32 Process into an NT base variant (Process.NT.cpp) with Win32 overloaded process exit pokes (Process.Win32.cpp)
2022-01-29 12:36:25 +00:00
a6f96315f3 [+] Move raminfo IsWin10 check over to the new cheaty api 2022-01-28 01:20:38 +00:00
086de4600f [*] Minor adjustments 2022-01-28 00:45:37 +00:00
d8e000b5c3 [*] Prevent WriteLater from entering a deadlock condition. OnFlushs are no longer atomic
[*] Fix up gen1 copypasta
[+] ConsoleMessage::ToPersistentString
[*] Adjust ConsoleMessage formatting
2022-01-27 20:28:20 +00:00
5bc1985eca [+] Added ToString to CpuId
[*] Added const modifier to cpuid functions
[*] Added OnExit to planned API interface
[*] BlobReader now holds onto a handle of a ByteBuffer, allowing for shared usage -> aiding in the mitigation of allocations/second and needless heavy copy of objects
2022-01-27 07:45:42 +00:00
d7c6d66fad [+] AuBitsToLower, AuBitsToHigher (returns half of an input word)
[+] AuPopCnt
[+] NormalizePath, GetFileFromPath, GetDirectoryFromPath, GoUpToSeparator
[*] Fix Version Helpers again
[*] Fix registry locale memory check under read registry in SWInfo
[*] Breakout portable process code away from evil win32 code
[*] .dynlib -> .dylib under macos
2022-01-27 05:52:45 +00:00
fbd437d3d4 [+] Added LocaleStrings.hpp -> NewLine
[*] LocaleStrings should always return constant references
[*] Readded line splitting logic to the new Logger class
2022-01-26 08:30:19 +00:00
0d388dc4e2 [+] Added VersionHelpers
[*] Detabify
[*] Broke up CpuInfo
[*] I want to rewrite this trashy readme soon
2022-01-26 04:22:12 +00:00
7eb6900e9f [+] Added shared pointer extension, begin experimenting defining throw-on-null mechanic
[+] AuRemoveConst
[*] Support circular reference in Aurora pipelines Include, added support for early Aurora::Build AuroraEnum
[+] Added SWInfo API
[+] AU_COPY_MOVE, AU_MOVE, AU_COPY to go with AU_NO_... variants
[+] Adding GetProcessId
2022-01-26 00:22:02 +00:00
e5e36bd887 Large Commit
[*] Fix deadlock in the async subsystem (NoLockShutdown vs Shutdown in exception handler)
[+] Added ProccessMap NT variant
[+] Added ToolHelp image profiling
[*] Improved exception awareness
[*] Delegated SpawnThread to isolated TU, ready for reuse for RunAs and XNU Open - now with horrible evil alloc that could fail
[+] Added header for future api 'UtilRun'
[*] Improve NT core detection
[*] Changed small affinity bitmap to AuUInt64 instead of AuUInt32
[+] Added data structure to hold cpuids/affinity masks
[+] Implemented logger sinks
[+] Implemented logger glue logic
[*] Began migrating older loggers to sink-based default devices
[*] Minor refactors
[*] Improved internal exception discarding, not yet nothrow capable
[*] Minor create directory fix
2022-01-24 18:43:53 +00:00
8db441ff33 [*] preparing for autismo 2022-01-21 22:37:29 +00:00
66870a0f1a [*] Fix more scuffed time logic 2022-01-21 19:36:56 +00:00
5cba5f7b16 [*] uh wtf? 2022-01-21 17:28:52 +00:00
ed2b956b38 [*] Where'd my IsEmpty() go during refactoring? 2022-01-21 17:20:07 +00:00