0xdky's comments

0xdky | 3 years ago | on: Tom Lord has died

I worked on a POC porting it to Windows and had to port GNU tar to support large file names. TLA was truly revolutionary!

0xdky | 4 years ago | on: Bad Emacs Advice

Another lesson I learned from almost 2+ decades of using Emacs:

Track your customizations in a version control. Using customize package and reading the diff in dot Emacs file has taught me quite a bit about certain aspects of the package.

Side note: It would be awesome if Emacs could do the versioning as part of saving the customizations - build Emacs with libgit2 and make it a native git client.

0xdky | 4 years ago | on: You can't copy code with memcpy

I froze for a moment seeing this article after having worked at a major anti-virus company long time back and used some low level Win32 APIs.

Fortunately, I followed some of the techniques from “Programming Applications for Microsoft Windows” book and Detours project to intercept and execute custom code mostly based on loading custom DLL in target remote process and using DllMain() to execute.

0xdky | 4 years ago | on: Why Is C Faster Than Java (2009)

I had a colleague that wrote a tight loop creating objects in Java and in C++ on heap to show Java outperformed C++.

Once I implemented a simple pool allocator in C++, it ran circles around Java.

0xdky | 4 years ago | on: Reading NFS at 25GB/s using FIO and libnfs

I did something similar (~2015) but using the kernel NFS client and having multiple mounts to the same volume using different IP addresses.

Using vectored IO and spreading across multiple connections greatly improved throughout. However, metadata operations cannot be parallelized easily without application side changes.

In more modern kernels, NFS supports ‘nconnect’ mount option to open multiple network connections for a single mount. I wonder if the approach of using libnfs for multiple connections is even required.

https://github.com/0xdky/iotrap

0xdky | 4 years ago | on: Overengineering can kill a product

Wonder if the current hiring and rewarding contributes to over engineering?

How would you look if you just invoked APIs to get your work done versus designed and implemented an end to end solution.

Many times, I have seen over engineered solutions come from promotion attached initiatives.

0xdky | 4 years ago | on: The history of Berkeley DB

I used BDB as a Win32 profiler backend. The profiler was lightweight and would write a flat file with profiling data and function addresses to keep the captured data small.

A post processing tool would read the profiler data and create a BDB file with support for extracting call graphs and topN sort of analysis.

The final GUI was implemented in Visual Basic since other developers would not use the TUI/CLI based tools in console.

The next project used BDB to store file system metadata on embedded NAS storage. We implemented a fast ‘find’ like service based on file metadata (stat fields) stored in BDB with support for user defined file metadata.

0xdky | 4 years ago | on: Anatomy of a Terminal Emulator

Very well written article, thank you.

Especially when my daughter is taking a course on Unix and the instructor is superficially touching in these fundamental topics (due to their own limited understanding), I am going to use this to teach the underlying concepts.

0xdky | 4 years ago | on: Show HN: I built an app to create repeatable checklists to help with ADHD

On iOS, I have a repeating reminder. However, reminder notification in iOS is very non-intrusive and very easy to miss or dismiss.

I have a shortcut that runs everyday at bedtime and looks for any due reminders in a specific list. If it finds any, it will enable a dedicated alarm (alarm with a specific name, time and sound I have setup but disabled by default).

Alarms need more attention and action to dismiss than reminder notification and this has been working well for me so far.

I am trying to use any/all building blocks that come bundled on my phone and try not to install too many apps. Hence, this is just an alternative and not an attempt to downplay or trivialize the app in topic.

0xdky | 4 years ago | on: Porting OpenVMS from VAX to Alpha AXP (1992) [pdf]

I lead a team to implement CIFS server in VMS on Itanium after deciding not to port ASV (Advanced Server - CIFS server for Alpha since it had a lot of hand tuned assembly for a specific architecture).

We ported Samba and implemented a lot of C runtime functions to make porting less intrusive. As part of porting Samba to VMS, I made the early port of CVS client and streamline merging upstream changes with our VMS specific changes.

Some of the most infamous 4 letter words we cussed all time was the missing 'fork' and 'fcntl' and all the work arounds we had to put in to get Samba working...

I did meet quite a few very competent engineers from DEC times as part of my work and also interacted with David Butenhof of POSIX threads fame when debugging a thread library he and their team had developed and was used by ASV.

0xdky | 5 years ago | on: Why are tar.xz files 15x smaller when using Python's tar compared to macOS tar?

FWIK, compression works by de-duplication. Finding duplicate patterns is limited to a window.

If similar patterns are close to each other, there is a higher probability of finding such duplicates in the window leading to better compression.

When the files are not sorted, this randomly distributed files with similar patterns beyond the compression window leading to poor compression.

If there is an option to increase the size of window, that would be a good experiment.

This is very similar to `git repack` window and depth parameters. Larger the window and depth, you get better compressed packs.

Wonder if a sort based on diffs (group similar files together) would help get best compression. The cost of such sorting might outweigh the benefits.

0xdky | 5 years ago | on: Products vs. Protocols: What Signal got right

This looks very similar to the Android eco system suffering from fragmentation. It has become impossible to ensure updates across OEMs and this could be affecting some of the feature work - in the name of compatibility.

With Apple owning the spec and implementation and with no fragmentation, they can move very fast.

As long as there is no authority to mandate certain communication protocols (messaging, email, video) during certification, unified messaging unfortunately will remain a dream.

page 1