DevOps & Инфраструктура

2

awesome-kubernetes

devops

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-kubernetes — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

Awesome-Kubernetes
#

A curated list for awesome kubernetes sources inspired by @sindresorhus’ awesome

“Talent wins games, but teamwork and intelligence wins championships.”
– Michael Jordan

Without the help from these amazing contributors, building this awesome-repo would never have been possible. Thank You very much everyone !!

Thanks to Gitbook.This awesome list can now be downloaded and read in the form of a book. Check it out –> https://ramitsurana.gitbook.io/awesome-kubernetes/docs .Keep Learning Keep Sharing !!

If you see a package or project here that is no longer maintained or is not a good fit, please submit a pull request to improve this file. Thank you!

What is Kubernetes?
#

Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery.

Source: What is Kubernetes

History
#

Kubernetes is known to be a descendant of Google’s system BORG

The first unified container-management system developed at Google was the system we internally call Borg. It was built to manage both long-running services and batch jobs, which had previously been handled by two separate systems: Babysitter and the Global Work Queue. The latter’s architecture strongly influenced Borg, but was focused on batch jobs; both predated Linux control groups.

Source: Kubernetes Past

Date of Birth
#

Kubernetes celebrates its birthday every year on 21st July. Kubernetes 1.0 was released on July 21 2015, after being first announced to the public at Dockercon in June 2014.

Roadmap
#

The awesome-kubernetes will now soon be available in the form of different releases and package bundles, It means that you can download the awesome kubernetes release up to a certain period of time, The release for awesome kubernetes 2015 bundle is released. Checkout the releases column for more info.

Featured On
#

Starting Point
#

A place that marks the beginning of a journey

Contributing
#

Contributions are most welcome!

This list is just getting started, please contribute to make it super awesome.

Check out the Contributing Guidelines.

License
#

awesome-kubernetes by Ramit Surana is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

awesome-nix

devops

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-nix — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

A curated list of the best resources in the Nix community.

Nix is a powerful package manager for Linux and other Unix systems that makes package management reliable and reproducible.

Please read the contribution guidelines before contributing.

Contents
#

Resources
#

Learning
#

Building a Rust service with Nix - An in-depth blog series about creating a Rust application with Nix.
Explainix - Explain Nix syntax visually.
How to Learn Nix - It’s like a Let’s Play, but for obscure software documentation.
Nix - A One Pager - A one page introduction to the Nix language.
nix-book - A comprehensive guide to NixOS hardening and configuration.
Nix from First Principles: Flake Edition - A modern crash-course to using Nix features, Flakes, and developing with Nix.
Nix in 100 Seconds - A YouTube video from Fireship presenting Nix in 100 seconds.
Nix Notes - A collection of short notes about Nix, each contributing to the same virtual machine image.
Nix Pills - The best way to learn, with examples.
Nix Shorts - A collection of short notes about how to use Nix, updated for Nix Flakes.
Nix Starter Config - A few simple Nix Flake templates for getting started with NixOS + home-manager.
nix.dev - An opinionated guide for developers about getting things done using the Nix ecosystem.
NixOS & Flakes Book - An unofficial and opinionated NixOS & Flakes book for beginners.
NixOS Asia Tutorial Series - A series of high-level tutorials on using Nix Flakes, NixOS, home-manager, etc.
NixOS in Production - Free (pay-what-you-want) book in pdf format.
Unofficial NixOS test driver manual - Opinionated unofficial NixOS test driver manual with quick getting started guides and best practices.
Official Nix manual - Latest stable version of the official Nix manual, best used as reference guide. Receives updates when available.
Official NixOS manual - Latest stable version of the official NixOS manual, mix of tutorial and reference guide. Receives updates when available.
Official Nixpkgs manual - Latest stable version of the official Nixpkgs reference manual. Receives updates when available.
Tour of Nix - An online interactive tutorial on Nix language constructs.
Wombat’s Book of Nix - A book-length introduction to Nix and flakes.
Zero to Nix - A flake-centric guide to Nix and its concepts created by Determinate Systems to quickly onboard beginners.

Discovery
#

Home Manager Option Search - Search through all 2000+ Home Manager options and read how to use them.

Nix Package Versions - Find all versions of a package that were available in a channel and the revision you can download it from.
Nix Software - Friendly package search. Supports logos, screenshots, categories, and translations into multiple languages.
nix-search-tv - CLI fuzzy finder for packages and options from Nixpkgs, Home Manager, and more.
Noogle - Nix API search engine allowing to search functions based on their types and other attributes.
NüschtOS Search - Simple and fast static-page NixOS option search.
Searchix - Search Nix packages and options from NixOS, Darwin and Home Manager.

Installation Media
#

nix-installer-scripts - Runs the official installer but does some tweaking as well such as adding fcontext for selinux and installing nix outside of the default profile so you don’t accidently uninstall it.
nix-installer - Opinionated alternative to the official Nix install scripts.
nixos-anywhere - Install NixOS everywhere via SSH.
nixos-generators - Take a NixOS config and build multiple different images types including VirtualBox VMs, Azure images, and installation ISOs.
nixos-infect - Replace a running non-NixOS Linux host with NixOS.
nixos-up - Super easy NixOS installer that can be used from the installation ISO.

Channel History
#

npc - CLI to view and bisect Nixpkgs channel history.
Nix Infra Status - Get the age and current Git commit of each Nix channel.
Nix Review Tools Reports - Reports showing problematic dependencies (dependencies causing the most failed builds) for major Hydra jobsets.

nixpkgs PR tracker - A tracker for whether a PR has made it into a channel yet.

Deployment Tools
#

bento - A KISS deployment tool to keep your NixOS fleet (servers & workstations) up to date.
Clan - A peer-to-peer deployment tool with inbuilt support for secrets and a module system to manage distributed networks.
Colmena - A simple, stateless NixOS deployment tool modeled after NixOps and morph.
comin - A deployment tool to continuously pull from Git repositories.
deploy-rs - A simple multi-profile Nix-flake deploy tool.
krops - A lightweight toolkit to deploy NixOS systems, remotely or locally.
KubeNix - A Kubernetes resource builder using Nix.
KuberNix - Single-dependency Kubernetes clusters via Nix packages.
morph - A tool for managing existing NixOS hosts.
Nixery - A Docker-compatible container registry which builds images ad-hoc via Nix.
Nixinate - A Nix flake library to provide app outputs for managing existing NixOS hosts over SSH.
Nixlets - Like Helm but using only Nix, uses Kubenix under the hood.
NixOps - The official Nix deployment tool, compatible with AWS, Hetzner, and more.
pushnix - Simple cli utility that pushes NixOS configuration and triggers a rebuild using ssh.
terraform-nixos - A set of Terraform modules designed to deploy NixOS.
terranix - Use Nix and the NixOS module system to write your Terraform code.

Virtualisation
#

agent-sandbox.nix - Declarative sandboxing for any package (e.g. AI coding agents) using bubblewrap on Linux and sandbox-exec on macOS.
extra-container - Run declarative NixOS containers from the command line.
microvm - NixOS-based MicroVMs.
nixos-shell - Simple headless VM configuration using Nix (similar to Vagrant).

Command-Line Tools
#

alejandra - An opinionated Nix code formatter optimized for speed and consistency.
angrr - Auto Nix GC Roots Retention. This tool simply deletes auto GC roots based on the modified time of their symbolic link target.
comma - Quickly run any binary; wraps together nix run and nix-index.
deadnix - Scan Nix files for dead code.
devenv - A Nix-based tool for creating developer shell environments quickly and reproducibly.
dix - Diff Nix; a super-fast tool to diff Nix related things.
manix - Find configuration options and function documentation for Nixpkgs, NixOS, and Home Manager.
nh - Better output for nix, nixos-rebuild, home-manager and nix-darwin CLI leveraging dix and nix-output-monitor.
nix-alien - Run unpatched binaries on Nix/NixOS easily.
nix-diff - A tool to explain why two Nix derivations differ.
nix-du - Visualise which gc-roots to delete to free some space in your Nix store.
nix-index - Quickly locate Nix packages with specific files.
nix-init - Generate Nix packages from URLs with hash prefetching, dependency inference, license detection, and more.
nix-melt - A ranger-like flake.lock viewer.
nix-output-monitor - A tool to produce useful graphs and statistics when building derivations.
nix-prefetch - A universal tool for updating source checksums.
nix-tree - Interactively browse the dependency graph of Nix derivations.
nixfmt - A formatter for Nix code, intended to easily apply a uniform style.
nixos-cli - Configurable all-in-one CLI for common NixOS tools with an emphasis on improved user experience.
nixpkgs-hammering - An opinionated linter for Nixpkgs package expressions.
nurl - Generate Nix fetcher calls from repository URLs.
nvd - Diff package versions between two store paths; it’s especially useful for comparing NixOS generations on rebuild.
optnix - A terminal-based options searcher for Nix module systems.
statix - A linter/fixer to check for and fix antipatterns in Nix code.

Development
#

Arion - Run docker-compose with help from Nix/NixOS.
attic - Multi-tenant Nix Binary Cache.
cached-nix-shell - A nix-shell replacement that uses caching to open subsequent shells quickly.
Cachix - Hosted binary cache service; free for open-source projects.
compose2nix - Generate a NixOS config from a Docker Compose project.
Conflake - A batteries included, autoload files, convention-based configuration framework for flake.nix.
Devbox - Instant, portable, and predictable development environments.
devshell - mkShell with extra bits and a toml config option to be able to onboard non-nix users.
dream2nix - A framework for automatically converting packages from other build systems to Nix.
flake-edit - Edit your flake inputs with auto-follows and update functionality directly from the CLI.
flake-utils-plus - A lightweight Nix library flake for painless NixOS flake configuration.
flake-utils - Pure Nix flake utility functions to help with writing flakes.
flake.parts - Minimal Nix modules framework for Flakes: split your flakes into modules and get things done with community modules.
flakelight - A modular flake framework aiming to minimize boilerplate.
flox - Manage and share development environments, package projects, and publish artifacts anywhere.
gitignore.nix - The most feature-complete and easy-to-use .gitignore integration.
haumea - Filesystem-based module system for the Nix language similar to traditional programming languages, with support for file hierarchy and visibility.
lorri - A much better nix-shell for development that augments direnv.
make-shell - mkShell meets modules, a modular almost-drop-in replacement for pkgs.mkShell function.
MCP-NixOS - An MCP server that provides AI assistants with accurate information about NixOS packages, options, Home Manager, and nix-darwin configurations.
namaka - Snapshot testing for Nix based on haumea.
nil - NIx Language server, an incremental analysis assistent for writing in Nix.
niv - Easy dependency management for Nix projects with package pinning.
nix2container - An efficient container building workflow with Nix.
nix-direnv - A fast loader and flake-compliant configuration for the direnv environment auto-loader.
nix-health - A program to check the health of your Nix install. Furthermore, individual projects can configure their own health checks in their flake.nix.
nix-oci - A flake-parts module for building minimal, reproducible OCI containers using nix2container.
nix-update - Update versions/source hashes of nix packages.
nixd - Nix language server, based on Nix libraries.
nixpkgs-review - The best tool to verify that a pull-request in Nixpkgs is building properly.
Nixtest - Testing framework for Nix, with snapshot and unit test support, JUnit generation etc.
npins - A simple tool for handling different types of dependencies in a Nix project. It is inspired by and comparable to Niv.
pog - A new, powerful way to do bash scripts. Pog is a powerful Nix library that transforms the way developers create command-line interfaces (CLIs).
pre-commit-hooks.nix - Run linters/formatters at commit time and on your CI.
rnix-lsp - A syntax-checking language server for Nix.
robotnix - A declarative and reproducible build system for Android (AOSP) images.
services-flake - A NixOS-like service configuration framework for Nix flakes.
Snowfall Lib - A library that makes it easy to manage your Nix flake by imposing an opinionated file structure.
templates - Project templates for many languages using Nix flakes.
treefmt-nix - A formatter that allows formatting all your project files with a single command, all via a single .nix file.

DevOps
#

Nix GitLab CI - Define GitLab CI pipelines in pure Nix with full access to all Nix packages (incl. caching).
nixidy - Kubernetes GitOps with Nix and Argo CD.
Standard - An opinionated Nix Flakes framework to keep Nix code in large projects organized, accompanied by a friendly CLI/TUI optized for DevOps scenarios.

Programming Languages
#

Arduino
#

nixduino - Nix-based tool to help build Arduino sketches.

Clojure
#

clj-nix - Nix helper functions for Clojure projects.

Crystal
#

crystal2nix - Convert shard.lock into Nix expressions.

Elixir
#

deps_nix - Converts Mix dependencies to Nix derivations.

Elm
#

elm2nix - Convert elm.json into Nix expressions.

Gleam
#

nix-gleam - Generic Nix builder for Gleam applications.

Haskell
#

cabal2nix - Converts a Cabal file into a Nix build expression.
haskell-flake - A flake-parts Nix module for Haskell development.
haskell.nix - Alternative Haskell Infrastructure for Nixpkgs.
nix-haskell-mode - Automatic Haskell setup in Emacs.
nixkell - A Haskell project template using Nix and direnv.

Haxe
#

haxix - Nix flake to build haxe/Heaps.io projects.
kebab - Haxe packages for Nix.

Julia
#

Manifest2Nix.jl - A Nix library for creating reproducible Julia builds and experiments via precompilation.

Lean
#

lean4-nix - Nix flake build for Lean 4, and lake2nix.

Node.js
#

…превью ограничено; полный список — в репозитории.

Web & Frontend

1

frontend-dev-bookmarks

web

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: frontend-dev-bookmarks — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

Manually curated collection of resources for frontend web developers.

You are viewing a browseable version, split by category in many small files. There is also a really huge file with every single resource on one page. Proceed to the totally gigantic file if you are into this kind of thing.

This is the current version, which receives ongoing updates. If you want the good old bookmarks, please use the tag v.1.0. Keep in mind, that the old version has many outdated links.

Appearance
#

The outward or visible aspect of a website.

Animation: The process of creating motion and shape change.
Typography: The style, arrangement, or appearance of typeset matter.
Visualization: Placing data in a visual context.

Architecture
#

High level structure of the frontend code and the discipline of creating such structures.

Algorithms: A self-contained step-by-step set of operations to be performed. Algorithms perform calculation, data processing, and/or automated reasoning tasks.
Design Patterns: Best practices that the programmer can use to solve common problems when designing an application or system.
Designs: Ready to use and well documented structures and frameworks for frontend development.
Event-Driven Programming: Event-driven programming is a programming paradigm in which the flow of the program is determined by events such as user actions, sensor outputs, or messages from other programs/threads.
Functional Programming: Functional programming is a programming paradigm, that treats computation as the evaluation of mathematical functions and avoids changing-state and mutable data.
Functional Reactive Programming (FRP): FRP is a programming paradigm for asynchronous dataflow programming using the building blocks of functional programming.

Compatibility
#

Ability of a product to work with different input/output devices and rendering software. Including printers, email, mobile devices and different browsers.

Cross Browser: Cross-browser refers to the ability of a website, web application, HTML construct or client-side script to function in environments that provide its required features and to bow out or degrade gracefully when features are absent or lacking.
E-Mail: Preparing HTML based electronic mail.
Keyboard: Working with keyboard input in a web browser.
Mobile: Development of websites optimized for viewing on smartphone and tablet devices.
Printers: Manipulation of printer output through CSS.
Responsive Web Design (RWD): RWD responds to the needs of the users and the devices they’re using. The layout changes based on the size and capabilities of the device.
Web Accessibility: Web accessibility means that people with disabilities can perceive, understand, navigate, and interact with the Web, and that they can contribute to the Web.

Ecosystem
#

Important developers, companies, organizations and news sources.

Communities Around Projects: Successful open source projects attract many developers who produce plugins, libraries, tutorials and other resources. This section collects such resources.
News: Websites & newsletters which provide daily and weekly news related to frontend web development.
Notable Community Members: Important engineers, evangelists, architects and other celebrities.
Organizations: Commercial companies and nonprofit organizations around web development.
Podcasts: A podcast is a form of digital media that consists of an episodic series of audio, video, digital radio, PDF, or ePub files subscribed to and downloaded automatically through web syndication or streamed online to a computer or mobile device.

Languages, Protocols, Browser APIs
#

Programming/mark-up languages and web related standards.

Cascading Style Sheets (CSS): CSS are a stylesheet language used to describe the presentation of a document written in HTML or XML. It describes how elements should be rendered on screen, on paper, in speech, or on other media.
Document Object Model (DOM): The DOM is a programming interface for HTML, XML and SVG documents. It defines methods that allow access to the tree, so that they can change the document structure, style and content.
HyperText Markup Language (HTML): HTML is the standard markup language used to create web pages and its elements form the building blocks of all websites.
Hypertext Transfer Protocol (HTTP): The Hypertext Transfer Protocol (HTTP) is an application protocol for distributed, collaborative, hypermedia information systems. HTTP is the foundation of data communication for the World Wide Web.
JavaScript (EcmaScript): JavaScript is a full-fledged dynamic programming language that, when applied to an HTML document, can provide dynamic interactivity on websites. It is defined by ECMAScript standard.
JavaScript Object Notation (JSON): JSON (JavaScript Object Notation) is a lightweight data-interchange format. It is easy for humans to read and write. It is easy for machines to parse and generate. It is based on a subset of the JavaScript Programming Language.
Scalable Vector Graphics (SVG): An XML-based vector image format for two-dimensional graphics with support for interactivity and animation.
Service Workers: A method that enables applications to take advantage of persistent background processing, including hooks to enable bootstrapping of web applications while offline.
Templating Languages and Engines: Template engines are tools to separate program-logic and presentation into two independent parts. This makes the development of both logic and presentation easier, improves flexibility and eases modification and maintenance.
Transpiled Languages: Abstract languages converted to native, browser supported standards like JavaScript or CSS.
Uniform Resource Identifier (URI): URI is a string of characters used to identify a resource. The most common form of URI is the Uniform Resource Locator (URL).
Web Animations API: Web Animations is a new JavaScript API for driving animated content on the web. By unifying the animation features of SVG and CSS, Web Animations unlocks features previously only usable declaratively, and exposes powerful, high-performance animation capabilities to developers.
WebAssembly: WebAssembly is meant to fill a place that JavaScript has been forced to occupy up to now: a low-level code representation that can serve as a compiler target.

User Interface Components
#

Drop-in UI components for web sites and applications.

Buttons: The term button refers to any graphical control element that provides the user a simple way to trigger an event, like searching for a query at a search engine, or to interact with dialog boxes, like confirming an action.
Code: Code viewers and editors designed for embedding inside a website.
Forms: A HTML form on a web page allows a user to enter data that is sent to a server for processing. Web users fill out the forms using checkboxes, radio buttons, or text fields.
Galeries & Image Sliders: A sophisticated way to present a collection of images on your website.
Grid: CSS Grid Layout Systems.
Rich Text Editors: A rich text editor is the interface for editing rich text within web browsers. The aim is to reduce the effort for users trying to express their formatting directly as valid HTML markup.
Table Of Contents: Components for automatic table of contents generation.
UI Kits: Collections of ready to use components.
Video & Audio: Components for playing audio and video files on a website.

Workflow
#

Task automation and asset delivery.

Automated Testing: Automated software testing is a process in which software tools execute pre-scripted tests on a software application before it is released into production.
Build Tools: Toolkits and their ecosystems, that help you automate painful and repeated tasks.
CSS Tools: Tools for analysis, pre and post processing of CSS files.
Code Editors: Text editor programs designed specifically for editing source code of a website.
Documentation: Writing, generating, publishing and consuming documentation for web deliverables.
Fonts for Programmers: Programmers need special fonts, which help align the code and distinguish between characters, that look alike.
Getting Started: Step by step guides for setting up a frontend development workflow.
HTML Tools: Tools for pre and post processing of the HTML source code.
Image Post Processing: Tools for image conversion and optimization.
JavaScript Tools: Tools for static analysis, pre and post processing of JavaScript files.
Package Management: A package manager or package management system is a collection of software tools that automates the process of installing, upgrading, configuring, and removing reusable libraries and components in a consistent manner.
Sourcemaps: Sourcemap is a way to map a combined/minified file back to an unbuilt state.
Version Control: Version control or source control is a system that records changes to a file or set of files over time so that you can recall specific versions later.

License
#

This work is licensed under a Creative Commons Attribution 4.0 International License.

Please provide a link back to this repository. This is not necessary for GitHub forks.

Безопасность

1

awesome-security

security

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-security — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

A collection of awesome software, libraries, documents, books, resources and cool stuff about security.

Inspired by awesome-php, awesome-python.

Thanks to all contributors, you’re awesome and wouldn’t be possible without you! The goal is to build a categorized community-driven collection of very well-known resources.

Awesome Security

Network
#

Network architecture
#

Network-segmentation-cheat-sheet - This project was created to publish the best practices for segmentation of the corporate network of any company. In general, the schemes in this project are suitable for any company.

Scanning / Pentesting
#

OpenVAS - OpenVAS is a framework of several services and tools offering a comprehensive and powerful vulnerability scanning and vulnerability management solution.
Metasploit Framework - A tool for developing and executing exploit code against a remote target machine. Other important sub-projects include the Opcode Database, shellcode archive and related research.
Kali - Kali Linux is a Debian-derived Linux distribution designed for digital forensics and penetration testing. Kali Linux is preinstalled with numerous penetration-testing programs, including nmap (a port scanner), Wireshark (a packet analyzer), John the Ripper (a password cracker), and Aircrack-ng (a software suite for penetration-testing wireless LANs).
tsurugi - heavily customized Linux distribution that designed to support DFIR investigations, malware analysis and OSINT activities. It is based on Ubuntu 20.04(64-bit with a 5.15.12 custom kernel)
pig - A Linux packet crafting tool.
scapy - Scapy: the python-based interactive packet manipulation program & library.
Pompem - Pompem is an open source tool, which is designed to automate the search for exploits in major databases. Developed in Python, has a system of advanced search, thus facilitating the work of pentesters and ethical hackers. In its current version, performs searches in databases: Exploit-db, 1337day, Packetstorm Security…
Nmap - Nmap is a free and open source utility for network discovery and security auditing.
Amass - Amass performs DNS subdomain enumeration by scraping the largest number of disparate data sources, recursive brute forcing, crawling of web archives, permuting and altering names, reverse DNS sweeping and other techniques.
Anevicon - The most powerful UDP-based load generator, written in Rust.
Finshir - A coroutines-driven Low & Slow traffic generator, written in Rust.
Legion - Open source semi-automated discovery and reconnaissance network penetration testing framework.
Lonkero - Enterprise-grade web vulnerability scanner with 60+ attack modules, built in Rust for penetration testing and security assessments.
Sublist3r - Fast subdomains enumeration tool for penetration testers
RustScan - Faster Nmap scanning with Rust. Take a 17 minute Nmap scan down to 19 seconds.
Boofuzz - Fuzzing engine and fuzz testing framework.
monsoon - Very flexible and fast interactive HTTP enumeration/fuzzing.
Netz- Discover internet-wide misconfigurations, using zgrab2 and others.
Deepfence ThreatMapper - Apache v2, powerful runtime vulnerability scanner for kubernetes, virtual machines and serverless.
Deepfence SecretScanner - Find secrets and passwords in container images and file systems.
Cognito Scanner - CLI tool to pentest Cognito AWS instance. It implements three attacks: unwanted account creation, account oracle and identity pool escalation

Monitoring / Logging
#

BoxyHQ - Open source API for security and compliance audit logging.
justniffer - Justniffer is a network protocol analyzer that captures network traffic and produces logs in a customized way, can emulate Apache web server log files, track response times and extract all “intercepted” files from the HTTP traffic.
httpry - httpry is a specialized packet sniffer designed for displaying and logging HTTP traffic. It is not intended to perform analysis itself, but to capture, parse, and log the traffic for later analysis. It can be run in real-time displaying the traffic as it is parsed, or as a daemon process that logs to an output file. It is written to be as lightweight and flexible as possible, so that it can be easily adaptable to different applications.
ngrep - ngrep strives to provide most of GNU grep’s common features, applying them to the network layer. ngrep is a pcap-aware tool that will allow you to specify extended regular or hexadecimal expressions to match against data payloads of packets. It currently recognizes IPv4/6, TCP, UDP, ICMPv4/6, IGMP and Raw across Ethernet, PPP, SLIP, FDDI, Token Ring and null interfaces, and understands BPF filter logic in the same fashion as more common packet sniffing tools, such as tcpdump and snoop.
passivedns - A tool to collect DNS records passively to aid Incident handling, Network Security Monitoring (NSM) and general digital forensics. PassiveDNS sniffs traffic from an interface or reads a pcap-file and outputs the DNS-server answers to a log file. PassiveDNS can cache/aggregate duplicate DNS answers in-memory, limiting the amount of data in the logfile without loosing the essens in the DNS answer.
sagan - Sagan uses a ‘Snort like’ engine and rules to analyze logs (syslog/event log/snmptrap/netflow/etc).
ntopng - Ntopng is a network traffic probe that shows the network usage, similar to what the popular top Unix command does.
Fibratus - Fibratus is a tool for exploration and tracing of the Windows kernel. It is able to capture the most of the Windows kernel activity - process/thread creation and termination, file system I/O, registry, network activity, DLL loading/unloading and much more. Fibratus has a very simple CLI which encapsulates the machinery to start the kernel event stream collector, set kernel event filters or run the lightweight Python modules called filaments.
opensnitch - OpenSnitch is a GNU/Linux port of the Little Snitch application firewall
wazuh - Wazuh is a free and open source platform used for threat prevention, detection, and response. It is capable of monitoring file system changes, system calls and inventory changes.
Matano: Open source serverless security lake platform on AWS that lets you ingest, store, and analyze petabytes of security data into an Apache Iceberg data lake and run realtime Python detections as code.
Falco - The cloud-native runtime security project and de facto Kubernetes threat detection engine now part of the CNCF.
VAST - Open source security data pipeline engine for structured event data, supporting high-volume telemetry ingestion, compaction, and retrieval; purpose-built for security content execution, guided threat hunting, and large-scale investigation.
Substation - Substation is a cloud native data pipeline and transformation toolkit written in Go.
Sigma2KQL - A repository of all SIGMA rules converted to KQL that runs on a weekly schedule to update the repository and align with the up to date version of the SIGMA rules repository.
Sigma2SPL - A repository of all SIGMA rules converted to SPL that runs on a weekly schedule to update the repository and align with the up to date version of the SIGMA rules repository.
TerraSigma - A repository of all SIGMA rules converted to Microsoft Sentinel Terraform Scheduled analytic resources. The repository runs on a weekly schedule to update the repository and align with the up to date version of the SIGMA rules repository. Proper entity mapping is completed for the rules to ensure the repo is plug-and-play.

IDS / IPS / Host IDS / Host IPS
#

Snort - Snort is a free and open source network intrusion prevention system (NIPS) and network intrusion detection system (NIDS)created by Martin Roesch in 1998. Snort is now developed by Sourcefire, of which Roesch is the founder and CTO. In 2009, Snort entered InfoWorld’s Open Source Hall of Fame as one of the “greatest [pieces of] open source software of all time”.
Zeek - Zeek is a powerful network analysis framework that is much different from the typical IDS you may know.
- zeek2es - An open source tool to convert Zeek logs to Elastic/OpenSearch. You can also output pure JSON from Zeek’s TSV logs!
DrKeithJones.com - A blog on cyber security and network security monitoring.
OSSEC - Comprehensive Open Source HIDS. Not for the faint of heart. Takes a bit to get your head around how it works. Performs log analysis, file integrity checking, policy monitoring, rootkit detection, real-time alerting and active response. It runs on most operating systems, including Linux, MacOS, Solaris, HP-UX, AIX and Windows. Plenty of reasonable documentation. Sweet spot is medium to large deployments.
Suricata - Suricata is a high performance Network IDS, IPS and Network Security Monitoring engine. Open Source and owned by a community run non-profit foundation, the Open Information Security Foundation (OISF). Suricata is developed by the OISF and its supporting vendors.
Security Onion - Security Onion is a Linux distro for intrusion detection, network security monitoring, and log management. It’s based on Ubuntu and contains Snort, Suricata, Zeek, OSSEC, Sguil, Squert, Snorby, ELSA, Xplico, NetworkMiner, and many other security tools. The easy-to-use Setup wizard allows you to build an army of distributed sensors for your enterprise in minutes!
sshwatch - IPS for SSH similar to DenyHosts written in Python. It also can gather information about attacker during the attack in a log.
Stealth - File integrity checker that leaves virtually no sediment. Controller runs from another machine, which makes it hard for an attacker to know that the file system is being checked at defined pseudo random intervals over SSH. Highly recommended for small to medium deployments.
AIEngine - AIEngine is a next generation interactive/programmable Python/Ruby/Java/Lua packet inspection engine with capabilities of learning without any human intervention, NIDS(Network Intrusion Detection System) functionality, DNS domain classification, network collector, network forensics and many others.
Denyhosts - Thwart SSH dictionary based attacks and brute force attacks.
Fail2Ban - Scans log files and takes action on IPs that show malicious behavior.
SSHGuard - A software to protect services in addition to SSH, written in C
Lynis - an open source security auditing tool for Linux/Unix.
CrowdSec - CrowdSec is a free, modern & collaborative behavior detection engine, coupled with a global IP reputation network. It stacks on Fail2Ban’s philosophy but is IPV6 compatible and 60x faster (Go vs Python), uses Grok patterns to parse logs and YAML scenario to identify behaviors. CrowdSec is engineered for modern Cloud / Containers / VM based infrastructures (by decoupling detection and remediation). Once detected, you can remedy threats with various bouncers (firewall block, nginx http 403, Captchas, etc.) while the aggressive IPs can be sent to CrowdSec for curation before being shared among all users to further strengthen the community
wazuh - Wazuh is a free and open source XDR platform used for threat prevention, detection, and response. It is capable of protecting workloads across on-premises, virtualized, containerized, and cloud-based environments. Great tool foor all kind of deployments, it includes SIEM capabitilies (indexing + searching + WUI).

Honey Pot / Honey Net
#

awesome-honeypots - The canonical awesome honeypot list.
HoneyPy - HoneyPy is a low to medium interaction honeypot. It is intended to be easy to: deploy, extend functionality with plugins, and apply custom configurations.
Conpot - ICS/SCADA Honeypot. Conpot is a low interactive server side Industrial Control Systems honeypot designed to be easy to deploy, modify and extend. By providing a range of common industrial control protocols we created the basics to build your own system, capable to emulate complex infrastructures to convince an adversary that he just found a huge industrial complex. To improve the deceptive capabilities, we also provided the possibility to server a custom human machine interface to increase the honeypots attack surface. The response times of the services can be artificially delayed to mimic the behaviour of a system under constant load. Because we are providing complete stacks of the protocols, Conpot can be accessed with productive HMI’s or extended with real hardware. Conpot is developed under the umbrella of the Honeynet Project and on the shoulders of a couple of very big giants.
Amun - Amun Python-based low-interaction Honeypot.
Glastopf - Glastopf is a Honeypot which emulates thousands of vulnerabilities to gather data from attacks targeting web applications. The principle behind it is very simple: Reply the correct response to the attacker exploiting the web application.
Kippo - Kippo is a medium interaction SSH honeypot designed to log brute force attacks and, most importantly, the entire shell interaction performed by the attacker.
Kojoney - Kojoney is a low level interaction honeypot that emulates an SSH server. The daemon is written in Python using the Twisted Conch libraries.
HonSSH - HonSSH is a high-interaction Honey Pot solution. HonSSH will sit between an attacker and a honey pot, creating two separate SSH connections between them.
Bifrozt - Bifrozt is a NAT device with a DHCP server that is usually deployed with one NIC connected directly to the Internet and one NIC connected to the internal network. What differentiates Bifrozt from other standard NAT devices is its ability to work as a transparent SSHv2 proxy between an attacker and your honeypot. If you deployed an SSH server on Bifrozt’s internal network it would log all the interaction to a TTY file in plain text that could be viewed later and capture a copy of any files that were downloaded. You would not have to install any additional software, compile any kernel modules or use a specific version or type of operating system on the internal SSH server for this to work. It will limit outbound traffic to a set number of ports and will start to drop outbound packets on these ports when certain limits are exceeded.
HoneyDrive - HoneyDrive is the premier honeypot Linux distro. It is a virtual appliance (OVA) with Xubuntu Desktop 12.04.4 LTS edition installed. It contains over 10 pre-installed and pre-configured honeypot software packages such as Kippo SSH honeypot, Dionaea and Amun malware honeypots, Honeyd low-interaction honeypot, Glastopf web honeypot and Wordpot, Conpot SCADA/ICS honeypot, Thug and PhoneyC honeyclients and more. Additionally it includes many useful pre-configured scripts and utilities to analyze, visualize and process the data it can capture, such as Kippo-Graph, Honeyd-Viz, DionaeaFR, an ELK stack and much more. Lastly, almost 90 well-known malware analysis, forensics and network monitoring related tools are also present in the distribution.
Cuckoo Sandbox - Cuckoo Sandbox is an Open Source software for automating analysis of suspicious files. To do so it makes use of custom components that monitor the behavior of the malicious processes while running in an isolated environment.
T-Pot Honeypot Distro - T-Pot is based on the network installer of Ubuntu Server 16/17.x LTS. The honeypot daemons as well as other support components being used have been containerized using docker. This allows us to run multiple honeypot daemons on the same network interface while maintaining a small footprint and constrain each honeypot within its own environment. Installation over vanilla Ubuntu - T-Pot Autoinstall - This script will install T-Pot 16.04/17.10 on a fresh Ubuntu 16.04.x LTS (64bit). It is intended to be used on hosted servers, where an Ubuntu base image is given and there is no ability to install custom ISO images. Successfully tested on vanilla Ubuntu 16.04.3 in VMware.

Full Packet Capture / Forensic
#

tcpflow - tcpflow is a program that captures data transmitted as part of TCP connections (flows), and stores the data in a way that is convenient for protocol analysis and debugging. Each TCP flow is stored in its own file. Thus, the typical TCP flow will be stored in two files, one for each direction. tcpflow can also process stored ’tcpdump’ packet flows.
Deepfence PacketStreamer - High-performance remote packet capture and collection tool, distributed tcpdump for cloud native environments.
Xplico - The goal of Xplico is extract from an internet traffic capture the applications data contained. For example, from a pcap file Xplico extracts each email (POP, IMAP, and SMTP protocols), all HTTP contents, each VoIP call (SIP), FTP, TFTP, and so on. Xplico isn’t a network protocol analyzer. Xplico is an open source Network Forensic Analysis Tool (NFAT).
Moloch - Moloch is an open source, large scale IPv4 packet capturing (PCAP), indexing and database system. A simple web interface is provided for PCAP browsing, searching, and exporting. APIs are exposed that allow PCAP data and JSON-formatted session data to be downloaded directly. Simple security is implemented by using HTTPS and HTTP digest password support or by using apache in front. Moloch is not meant to replace IDS engines but instead work along side them to store and index all the network traffic in standard PCAP format, providing fast access. Moloch is built to be deployed across many systems and can scale to handle multiple gigabits/sec of traffic.
OpenFPC - OpenFPC is a set of tools that combine to provide a lightweight full-packet network traffic recorder & buffering system. It’s design goal is to allow non-expert users to deploy a distributed network traffic recorder on COTS hardware while integrating into existing alert and log management tools.
Dshell - Dshell is a network forensic analysis framework. Enables rapid development of plugins to support the dissection of network packet captures.
stenographer - Stenographer is a packet capture solution which aims to quickly spool all packets to disk, then provide simple, fast access to subsets of those packets.

Sniffer
#

wireshark - Wireshark is a free and open-source packet analyzer. It is used for network troubleshooting, analysis, software and communications protocol development, and education. Wireshark is very similar to tcpdump, but has a graphical front-end, plus some integrated sorting and filtering options.
netsniff-ng - netsniff-ng is a free Linux networking toolkit, a Swiss army knife for your daily Linux network plumbing if you will. Its gain of performance is reached by zero-copy mechanisms, so that on packet reception and transmission the kernel does not need to copy packets from kernel space to user space and vice versa.
Live HTTP headers - Live HTTP headers is a free firefox addon to see your browser requests in real time. It shows the entire headers of the requests and can be used to find the security loopholes in implementations.

Security Information & Event Management
#

Prelude - Prelude is a Universal “Security Information & Event Management” (SIEM) system. Prelude collects, normalizes, sorts, aggregates, correlates and reports all security-related events independently of the product brand or license giving rise to such events; Prelude is “agentless”.
OSSIM - OSSIM provides all of the features that a security professional needs from a SIEM offering – event collection, normalization, and correlation.
FIR - Fast Incident Response, a cybersecurity incident management platform.
LogESP - Open Source SIEM (Security Information and Event Management system).
wazuh -Wazuh is a free, open source and enterprise-ready security monitoring solution for threat detection, integrity monitoring, incident response and compliance. It works with tons of data supported by an OpenSearch fork and custom WUI.
VAST - Open source security data pipeline engine for structured event data, supporting high-volume telemetry ingestion, compaction, and retrieval; purpose-built for security content execution, guided threat hunting, and large-scale investigation.
Matano - Open source serverless security lake platform on AWS that lets you ingest, store, and analyze petabytes of security data into an Apache Iceberg data lake and run realtime Python detections as code.

VPN
#

OpenVPN - OpenVPN is an open source software application that implements virtual private network (VPN) techniques for creating secure point-to-point or site-to-site connections in routed or bridged configurations and remote access facilities. It uses a custom security protocol that utilizes SSL/TLS for key exchange.
Firezone - Open-source VPN server and egress firewall for Linux built on WireGuard that makes it simple to manage secure remote access to your company’s private networks. Firezone is easy to set up (all dependencies are bundled thanks to Chef Omnibus), secure, performant, and self hostable.
TorForge - Advanced transparent Tor proxy with kernel-level iptables routing, post-quantum encryption (Kyber768), kill switch, steganography mode, and AI-powered circuit selection.

Fast Packet Processing
#

DPDK - DPDK is a set of libraries and drivers for fast packet processing.
PFQ - PFQ is a functional networking framework designed for the Linux operating system that allows efficient packets capture/transmission (10G and beyond), in-kernel functional processing and packets steering across sockets/end-points.
PF_RING - PF_RING is a new type of network socket that dramatically improves the packet capture speed.
PF_RING ZC (Zero Copy) - PF_RING ZC (Zero Copy) is a flexible packet processing framework that allows you to achieve 1/10 Gbit line rate packet processing (both RX and TX) at any packet size. It implements zero copy operations including patterns for inter-process and inter-VM (KVM) communications.
PACKET_MMAP/TPACKET/AF_PACKET - It’s fine to use PACKET_MMAP to improve the performance of the capture and transmission process in Linux.
netmap - netmap is a framework for high speed packet I/O. Together with its companion VALE software switch, it is implemented as a single kernel module and available for FreeBSD, Linux and now also Windows.

Firewall
#

pfSense - Firewall and Router FreeBSD distribution.
OPNsense - is an open source, easy-to-use and easy-to-build FreeBSD based firewall and routing platform. OPNsense includes most of the features available in expensive commercial firewalls, and more in many cases. It brings the rich feature set of commercial offerings with the benefits of open and verifiable sources.
fwknop - Protects ports via Single Packet Authorization in your firewall.

Anti-Spam
#

Spam Scanner - Anti-Spam Scanning Service and Anti-Spam API by @niftylettuce.
rspamd - Fast, free and open-source spam filtering system.
SpamAssassin - A powerful and popular email spam filter employing a variety of detection technique.
Scammer-List - A free open source AI based Scam and Spam Finder with a free API

Docker Images for Penetration Testing & Security
#

docker pull kalilinux/kali-linux-docker official Kali Linux
docker pull owasp/zap2docker-stable - official OWASP ZAP
docker pull wpscanteam/wpscan - official WPScan
docker pull remnux/metasploit - docker-metasploit
docker pull citizenstig/dvwa - Damn Vulnerable Web Application (DVWA)
docker pull wpscanteam/vulnerablewordpress - Vulnerable WordPress Installation
docker pull hmlio/vaas-cve-2014-6271 - Vulnerability as a service: Shellshock
docker pull hmlio/vaas-cve-2014-0160 - Vulnerability as a service: Heartbleed
docker pull opendns/security-ninjas - Security Ninjas
docker pull diogomonica/docker-bench-security - Docker Bench for Security
docker pull ismisepaul/securityshepherd - OWASP Security Shepherd
docker pull danmx/docker-owasp-webgoat - OWASP WebGoat Project docker image
docker-compose build && docker-compose up - OWASP NodeGoat
docker pull citizenstig/nowasp - OWASP Mutillidae II Web Pen-Test Practice Application
docker pull bkimminich/juice-shop - OWASP Juice Shop
docker pull jeroenwillemsen/wrongsecrets- OWASP WrongSecrets
docker run -dit --name trd -p 8081:80 cylabs/cy-threat-response - Cyware Threat Response Docker
docker-compose -d up - cicd-goat

Endpoint
#

Anti-Virus / Anti-Malware
#

Fastfinder - Fast customisable cross-platform suspicious file finder. Supports md5/sha1/sha256 hashs, litteral/wildcard strings, regular expressions and YARA rules. Can easily be packed to be deployed on any windows / linux host.
Linux Malware Detect - A malware scanner for Linux designed around the threats faced in shared hosted environments.
LOKI - Simple Indicators of Compromise and Incident Response Scanner
rkhunter - A Rootkit Hunter for Linux
ClamAv - ClamAV® is an open-source antivirus engine for detecting trojans, viruses, malware & other malicious threats.

Content Disarm & Reconstruct
#

DocBleach - An open-source Content Disarm & Reconstruct software sanitizing Office, PDF and RTF Documents.

Configuration Management
#

Fleet device management - Fleet is the lightweight, programmable telemetry platform for servers and workstations. Get comprehensive, customizable data from all your devices and operating systems.
Rudder - Rudder is an easy to use, web-driven, role-based solution for IT Infrastructure Automation & Compliance. Automate common system administration tasks (installation, configuration); Enforce configuration over time (configuring once is good, ensuring that configuration is valid and automatically fixing it is better); Inventory of all managed nodes; Web interface to configure and manage nodes and their configuration; Compliance reporting, by configuration and/or by node.

Authentication
#

google-authenticator - The Google Authenticator project includes implementations of one-time passcode generators for several mobile platforms, as well as a pluggable authentication module (PAM). One-time passcodes are generated using open standards developed by the Initiative for Open Authentication (OATH) (which is unrelated to OAuth). These implementations support the HMAC-Based One-time Password (HOTP) algorithm specified in RFC 4226 and the Time-based One-time Password (TOTP) algorithm specified in RFC 6238. Tutorials: How to set up two-factor authentication for SSH login on Linux
Stegcloak - Securely assign Digital Authenticity to any written text

Mobile / Android / iOS
#

android-security-awesome - A collection of android security related resources. A lot of work is happening in academia and industry on tools to perform dynamic analysis, static analysis and reverse engineering of android apps.
SecMobi Wiki - A collection of mobile security resources which including articles, blogs, books, groups, projects, tools and conferences. *
OWASP Mobile Security Testing Guide - A comprehensive manual for mobile app security testing and reverse engineering.
OSX Security Awesome - A collection of OSX and iOS security resources
Themis - High-level multi-platform cryptographic framework for protecting sensitive data: secure messaging with forward secrecy and secure data storage (AES256GCM), suits for building end-to-end encrypted applications.
Mobile Security Wiki - A collection of mobile security resources.
Apktool - A tool for reverse engineering Android apk files.
jadx - Command line and GUI tools for produce Java source code from Android Dex and Apk files.
enjarify - A tool for translating Dalvik bytecode to equivalent Java bytecode.
Android Storage Extractor - A tool to extract local data storage of an Android application in one click.
Quark-Engine - An Obfuscation-Neglect Android Malware Scoring System.
dotPeek - Free-of-charge standalone tool based on ReSharper’s bundled decompiler.
hardened_malloc - Hardened allocator designed for modern systems. It has integration into Android’s Bionic libc and can be used externally with musl and glibc as a dynamic library for use on other Linux-based platforms. It will gain more portability / integration over time.
AMExtractor - AMExtractor can dump out the physical content of your Android device even without kernel source code.
frida - Dynamic instrumentation toolkit for developers, reverse-engineers, and security researchers.
UDcide - Android Malware Behavior Editor.
reFlutter - Flutter Reverse Engineering Framework

Forensics
#

…превью ограничено; полный список — в репозитории.

Блокчейн & DAO

1

awesome-blockchain

blockchain

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-blockchain — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

Curated list of resources for the development and applications of block chain.

The blockchain is an incorruptible digital ledger of economic transactions that can be programmed to record not just financial transactions but virtually everything of value (by Don Tapscott).

This is not a simple collection of Internet resources, but verified and organized data ensuring it’s really suitable for your learning process and useful for your development and application.

Contents
#

Click to expand

Awesome Blockchain

Frequently Asked Questions (F.A.Q.s) & Answers
#

Q: What’s a Blockchain?

A: A blockchain is a distributed database with a list (that is, chain) of records (that is, blocks) linked and secured by digital fingerprints (that is, crypto hashes). Example from genesis_block.json:

{
    "version": 0,
    "height": 1,
    "previous_hash": null,
    "timestamp": 1550049140488,
    "merkle_hash": null,
    "generator_publickey": "18941c80a77f2150107cdde99486ba672b5279ddd469eeefed308540fbd46983",
    "hash": "d611edb9fd86ee234cdc08d9bf382330d6ccc721cd5e59cf2a01b0a2a8decfff",
    "block_signature": "603b61b14348fb7eb087fe3267e28abacadf3932f0e33958fb016ab60f825e3124bfe6c7198d38f8c91b0a3b1f928919190680e44fbe7289a4202039ffbb2109",
    "consensus_data": {},
    "transactions": []
}

Q: What’s a Hash? What’s a (One-Way) Crypto(graphic) Hash Digest Checksum?

A: A hash e.g. d611edb9fd86ee234cdc08d9bf382330d6ccc721cd5e59cf2a01b0a2a8decfff is a small digest checksum calculated with a one-way crypto(graphic) hash digest checksum function e.g. SHA256 (Secure Hash Algorithm 256 Bits) from the data. Example from crypto.js:

function calc_hash(data) {
    return crypto.createHash('sha256').update(data).digest('hex');
}

A blockchain uses

the block header (e.g. Version, TimeStamp, Previous Hash... )and
the block data (e.g. Transaction Data...)

to calculate the new hash digest checksum.

Q: What’s a Merkle Tree?

A: A Merkle tree is a hash tree named after Ralph Merkle who patented the concept in 1979 (the patent expired in 2002). A hash tree is a generalization of hash lists or hash chains where every leaf node (in the tree) is labelled with a data block and every non-leaf node (in the tree) is labelled with the crypto(graphic) hash of the labels of its child nodes. For more see the Merkle tree Wikipedia Article.

Note: By adding crypto(graphic) hash functions you can “merkelize” any data structure.

Q: What’s a Merkelized DAG (Directed Acyclic Graph)?

A: It’s a blockchain secured by crypto(graphic) hashes that uses a directed acyclic graph data structure (instead of linear “classic” linked list).

Note: Git uses merkelized dag (directed acyclic graph)s for its blockchains.

Q: Is the Git Repo a Blockchain?

A: Yes, every branch in the git repo is a blockchain. The “classic” Satoshi-blockchain is like a git repo with a single master branch (only).

More Q&A

Basic Introduction
#

Encryption knowledge
- Basic concepts - Asymmetric encryption, Digital signature, Certificate
- Digital signature extension - Multi-signature, Blind signature, Group signature, Ring signature
- Merkle tree
- Merkle DAG
- CryptoNote v2.0 - Untraceable Transactions and Egalitarian Proof-of-work

Consensus

Account and transaction model
- UTXO model

Exchange

Applications

Governance
- Blockchains should not be democracies

Digital currency ranking

Development Tutorial
#

BitCoin
#

Bitcoin is an experimental digital currency that enables instant payments to anyone, anywhere in the world. Bitcoin uses peer-to-peer technology to operate with no central authority: managing transactions and issuing money are carried out collectively by the network.

But how does bitcoin actually work?
Mining visualization
Wallets
Explorers
Libraries - C++, JavaScript, PHP, Ruby, Python, Java, .Net
Web services
Full nodes
More

Ethereum
#

Ethereum is a decentralized platform that runs smart contracts: applications that run exactly as programmed without any possibility of downtime, censorship, fraud or third-party interference.

These apps run on a custom built blockchain, an enormously powerful shared global infrastructure that can move value around and represent the ownership of property.

Utils

EEA - Enterprise Ethereum: Private Blockchain For Enterprises

…превью ограничено; полный список — в репозитории.

Данные & ML

1

awesome-machine-learning

data

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-machine-learning — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

A curated list of awesome machine learning frameworks, libraries and software (by language). Inspired by awesome-php.

IMPORTANT NOTE ON PRs:
#

As of April 2026, too many PRs are being generated by LLMs, this is no longer fun or manageable. If you want to contribute to this repo, email me at joseph dot misiti @ hey dot com to prove you’re human with a link to your PR and I’ll merge it. Thank you for your understanding.

Also, a listed repository should be deprecated if:

Repository’s owner explicitly says that “this library is not maintained”.
Not committed for a long time (2~3 years).

Further resources:

For a list of free machine learning books available for download, go here.
For a list of professional machine learning events, go here.
For a list of (mostly) free machine learning courses available online, go here.
For a list of blogs and newsletters on data science and machine learning, go here.
For a list of free-to-attend meetups and local events, go here.

Star History
#

Table of Contents
#

Frameworks and Libraries
#

Awesome Machine Learning

Tools
#

Credits

APL
#

General-Purpose Machine Learning
#

naive-apl - Naive Bayesian Classifier implementation in APL. [Deprecated]

C
#

General-Purpose Machine Learning
#

Darknet - Darknet is an open source neural network framework written in C and CUDA. It is fast, easy to install, and supports CPU and GPU computation.
Recommender - A C library for product recommendations/suggestions using collaborative filtering (CF).
Hybrid Recommender System - A hybrid recommender system based upon scikit-learn algorithms. [Deprecated]
neonrvm - neonrvm is an open source machine learning library based on RVM technique. It’s written in C programming language and comes with Python programming language bindings.
cONNXr - An ONNX runtime written in pure C (99) with zero dependencies focused on small embedded devices. Run inference on your machine learning models no matter which framework you train it with. Easy to install and compiles everywhere, even in very old devices.
libonnx - A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
onnx-c - A lightweight C library for ONNX model inference, optimized for performance and portability across platforms.
notorch - Neural networks framework in pure C: training and inference, no dependencies.
qsmm - A C library implementing the rudiments of a toolchain for working with adaptive probabilistic assembler programs.

Computer Vision
#

CCV - C-based/Cached/Core Computer Vision Library, A Modern Computer Vision Library.
VLFeat - VLFeat is an open and portable library of computer vision algorithms, which has a Matlab toolbox.
YOLOv8 - Ultralytics’ YOLOv8 implementation with C++ support for real-time object detection and tracking, optimized for edge devices.
SpecX - Specialized AI vision for extracting engineering specs from PDF/JPG to Excel.

Speech Recognition
#

VoxRT - On-device streaming speech recognition runtime with C API for Linux (aarch64/x86_64). Based on NVIDIA NeMo FastConformer (80 ms cache-aware lookahead). Companion Silero VAD, wake-word, and 14-command KWS via same runtime.

C++
#

Computer Vision
#

DLib - DLib has C++ and Python interfaces for face detection and training general object detectors.
EBLearn - Eblearn is an object-oriented C++ library that implements various machine learning models [Deprecated]
OpenCV - OpenCV has C++, C, Python, Java and MATLAB interfaces and supports Windows, Linux, Android and Mac OS.
VIGRA - VIGRA is a genertic cross-platform C++ computer vision and machine learning library for volumes of arbitrary dimensionality with Python bindings.
Openpose - A real-time multi-person keypoint detection library for body, face, hands, and foot estimation

General-Purpose Machine Learning
#

- Agentic Context Engine -In-context learning framework that allows agents to learn from execution feedback.
Speedster -Automatically apply SOTA optimization techniques to achieve the maximum inference speed-up on your hardware. [DEEP LEARNING]
BanditLib - A simple Multi-armed Bandit library. [Deprecated]
Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind. [DEEP LEARNING]
CatBoost - General purpose gradient boosting on decision trees library with categorical features support out of the box. It is easy to install, contains fast inference implementation and supports CPU and GPU (even multi-GPU) computation.
CNTK - The Computational Network Toolkit (CNTK) by Microsoft Research, is a unified deep-learning toolkit that describes neural networks as a series of computational steps via a directed graph.
CUDA - This is a fast C++/CUDA implementation of convolutional [DEEP LEARNING]
DeepDetect - A machine learning API and server written in C++11. It makes state of the art machine learning easy to work with and integrate into existing applications.
Distributed Machine learning Tool Kit (DMTK) - A distributed machine learning (parameter server) framework by Microsoft. Enables training models on large data sets across multiple machines. Current tools bundled with it include: LightLDA and Distributed (Multisense) Word Embedding.
DLib - A suite of ML tools designed to be easy to imbed in other applications.
DSSTNE - A software library created by Amazon for training and deploying deep neural networks using GPUs which emphasizes speed and scale over experimental flexibility.
DyNet - A dynamic neural network library working well with networks that have dynamic structures that change for every training instance. Written in C++ with bindings in Python.
Fido - A highly-modular C++ machine learning library for embedded electronics and robotics.
FlexML - Easy-to-use and flexible AutoML library for Python.
igraph - General purpose graph library.
Intel® oneAPI Data Analytics Library - A high performance software library developed by Intel and optimized for Intel’s architectures. Library provides algorithmic building blocks for all stages of data analytics and allows to process data in batch, online and distributed modes.
LightGBM - Microsoft’s fast, distributed, high performance gradient boosting (GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
libfm - A generic approach that allows to mimic most factorization models by feature engineering.

…превью ограничено; полный список — в репозитории.

Инструменты & Прочее

4

awesome-go

tools

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-go — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

We use the Golang Bridge community Slack for instant communication, follow the form here to join.

Sponsorships:

Special thanks to

Awesome Go has no monthly fee, but we have employees who work hard to keep it running. With money raised, we can repay the effort of each person involved! You can see how we calculate our billing and distribution as it is open to the entire community. Want to be a supporter of the project click here.

A curated list of awesome Go frameworks, libraries, and software. Inspired by awesome-python.

Contributing:

Please take a quick gander at the contribution guidelines first. Thanks to all contributors; you rock!

If you see a package or project here that is no longer maintained or is not a good fit, please submit a pull request to improve this file. Thank you!

Contents
#

Expand contents

⬆ back to top

Actor Model
#

Libraries for building actor-based programs.

asyncmachine-go/pkg/machine - Graph control flow library (AOP, actor, state-machine).
Ergo - An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang.
Goakt - Fast and Distributed Actor framework using protocol buffers as message for Golang.
Hollywood - Blazingly fast and light-weight Actor engine written in Golang.
ProtoActor - Distributed actors for Go, C#, and Java/Kotlin.

⬆ back to top

Artificial Intelligence
#

Libraries for building programs that leverage AI.

AegisFlow - AI gateway for routing, securing, and monitoring LLM traffic across 10+ providers. OpenAI-compatible API, WASM policy plugins, canary rollouts, real-time dashboard.
Aetheris - AI Agent execution runtime with event sourcing, checkpoint recovery, and At-Most-Once execution guarantee. Written in Go.
agent-sdk-go - Go SDK for building durable AI agents on Temporal with support for tools, MCP, human approvals, and sub-agent delegation.
agy-mcp - Model Context Protocol (MCP) server wrapping the Antigravity CLI to run prompts and peer reviews.
ai - A Go toolkit for building AI agents and applications across multiple providers with unified LLM, embeddings, tool calling, and MCP integration.
chromem-go - Embeddable vector database for Go with Chroma-like interface and zero third-party dependencies. In-memory with optional persistence.
crewai-go - Idiomatic Go port of CrewAI (multi-agent orchestration). Zero dependencies, stdlib only.
dakera-go - Official Go client SDK for the Dakera self-hosted agent memory server, providing typed interfaces for memory store/recall, session management, namespace operations, and decay configuration.
fun - The simplest but powerful way to use large language models (LLMs) in Go.
goai - Go SDK for building AI applications. One SDK, 20+ providers. Inspired by Vercel AI SDK.
GoModel - AI gateway exposing a unified OpenAI-compatible API across OpenAI, Anthropic, Gemini, Groq, xAI, Ollama and other providers, with routing, usage tracking, rate limits, and guardrails.
hotplex - AI Agent runtime engine with long-lived sessions for Claude Code, OpenCode, pi-mono and other CLI AI tools. Provides full-duplex streaming, multi-platform integrations, and secure sandbox.
jargo - Framework for building real-time voice AI agents over WebRTC, wiring speech-to-text, LLMs, and text-to-speech into a streaming pipeline.
keen-code - A context-efficient terminal-based AI coding agent. Provider agnostic, supports MCPs, Agent Skills, Subagents, and more. Comes with a simple and straightforward TUI.
langchaingo - LangChainGo is a framework for developing applications powered by language models.
langgraphgo - A Go library for building stateful, multi-actor applications with LLMs, built on the concept of LangGraph，with a lot of builtin Agent architectures.
llm-box - Terminal-based AI workflow engine with YAML-driven pipelines, 20+ LLM providers (DeepSeek, Qwen, GLM, Mistral, etc.), and a TUI for workflow management.
LocalAI - Open Source OpenAI alternative, self-host AI models.
localaik - LocalStack-style local emulation of OpenAI and Gemini APIs; single Docker container, llama.cpp + Gemma 3 backend.
mcp-go - Go implementation of the Model Context Protocol for building MCP servers and clients in Go.
Ollama - Run large language models locally.
OllamaFarm - Manage, load-balance, and failover packs of Ollamas.
otellix - OpenTelemetry-native LLM observability and budget guardrails for cost-constrained production environments.
routex - YAML-driven multi-agent AI runtime for Go with Erlang-style supervision, MCP tool server support, and a CLI.
semantic-search - Meaning-based search over PDF, Markdown, DOCX, source code, and other file types, using generative AI embedding models to vectorize files into a vector database.
skillreaper - CLI that scans AI agent session transcripts to identify and safely quarantine unused skills, MCP servers, and agents across Claude Code, Codex CLI, Hermes, OpenCode, Cursor, and OpenClaw.
Smeldr - AI-native content backend with typed lifecycle management, native MCP tools for every content type, and zero runtime dependencies.
trpc-agent-go - Framework for building LLM-based multi-agent systems.
web-researcher-mcp - MCP server providing AI assistants with web search, content extraction, and multi-source research capabilities. Single binary, 5 search providers with circuit-breaker failover, 4-tier scraping pipeline.
zenflow - Multi-agent orchestration & workflow engine. Declarative YAML workflows, LLM coordinator with hub-and-spoke mailboxes, race-safe delivery. One YAML file, one Go binary. Runs on any goai-supported provider.

⬆ back to top

Audio and Music
#

Libraries for manipulating audio and music.

beep - A simple library for playback and audio manipulation.
flac - Native Go FLAC encoder/decoder with support for FLAC streams.

…превью ограничено; полный список — в репозитории.

awesome-mac

tools

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-mac — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

^{Special thanks to:}

getapps.cafe, 60+ native Mac apps across utilities, office, creative, and productivity categories, all running locally so your data never leaves your machine.

ScreenSage Pro, record beautiful screen recordings in minutes on macOS

LIZHI.SHOP - Selected Software. 100% Genuine. Best Deals.

IP.IM Free IP address information query website

^{Using my app is also a way to support me:}

Awesome Mac
#

This project is dedicated to collecting high-quality macOS software and organizing them systematically by different categories for easy search and use. As it continues to grow, the project has far exceeded our initial expectations and has become more comprehensive and refined.

Feel free to star ⭐ and fork 🍴 to support the project!

If you have any suggestions, ideas, or discover excellent software, feel free to submit a PR to help improve this list. Please read the contributing guidelines before contributing. We also welcome you to continue following this awesome list to build a better macOS tool collection together.

Explanation

中文 | 한국어 | 日本語 | RSS | Awesome Command Line Apps | Awesome Swift macOS Apps

![Open-Source Software][OSS Icon] means open source. click the icon to see the item’s repository;
![Freeware][Freeware Icon] means free to use, or free personal license;
![App Store][app-store Icon] means App store hyperlink;
![Native App][Native Icon] means native app;
![Awesome List][awesome-list Icon] means hyperlink to a corresponding Awesome list for the item;

Contents
#

Reading and Writing Tools
#

Applications to edit text, I suggest the open-source editors

Text Editors
#

Aurora Editor - Lightweight Code Editor (IDE) for macOS. ![Open-Source Software][OSS Icon]
Bootstrap Studio - A powerful desktop app for creating responsive websites using the Bootstrap framework.
Brackets - A modern, open source text editor that understands web design. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
CodeEdit - A lightweight, natively-built editor. Open source. Free forever. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
CotEditor - Lightweight plain-text editor for macOS. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Cursor - AI code editor with autocomplete, chat, and coding agent features. ![Freeware][Freeware Icon]
Emacs - Popular Unix-based text editor for programmers and system administrators. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon] ![Awesome List][awesome-list Icon]
Haystack Editor - Code editor with a canvas UI for better code understanding. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Helix - A post-modern modal text editor. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Itsypad - A tiny, fast scratchpad and clipboard manager for macOS. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Lapce - Lightning-fast and powerful code editor. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
LightTable - The next generation code editor. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
LiteEdit - Fast, native macOS code editor under 1 MB — Swift and AppKit, no Electron. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
MacVim - the text editor Vim - for macOS. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
micro - Modern and intuitive terminal-based text editor. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Neovim - Vim-fork focused on extensibility and usability. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Nova - The beautiful, fast, flexible, native Mac code editor from Panic.
Plain Text Editor - Simple distraction-free notepad. ![Freeware][Freeware Icon] ![App Store][app-store Icon]
Sublime Text - Text editor with a fast interface and plugin ecosystem. For more plugins, check Sublime Text Plugins. ![Awesome List][awesome-list Icon]
SubEthaEdit - Powerful editor for writing, coding, and collaboration anytime, anywhere! ![Open-Source Software][OSS Icon]
TextMate - Editor that brings Apple’s approach to operating systems into the world of text editors. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Tot - Tot is an elegant, simple way to collect & edit text. It’s your tiny text companion! ![Freeware][Freeware Icon] ![App Store][app-store Icon]
Vim - An old terminal-based editor. For common plugins, check Vim Common Plugins. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon] ![Awesome List][awesome-list Icon]
Vimr - Refined Vim Experience for OS X. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Windsurf - AI code editor with agentic coding, autocomplete, and MCP support. ![Freeware][Freeware Icon]
Zed - A high-performance, multiplayer code editor from the creators of Atom and Tree-sitter. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]

Office
#

Keynote - Build stunning presentations. ![Freeware][Freeware Icon] ![App Store][app-store Icon]
LibreOffice - Free, open-source office software used and tested daily by a large community. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Microsoft Office - Unmistakably Office, designed for Mac. ![App Store][app-store Icon]
Numbers - Create impressive spreadsheets. ![Freeware][Freeware Icon] ![App Store][app-store Icon]
OnlyOffice - Office suite with document, spreadsheet, and presentation editors. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Pages - Documents that stand apart. ![Freeware][Freeware Icon] ![App Store][app-store Icon]
SoftMaker Office - A complete office suite that aims for full compatibility with Microsoft Office documents.
WPS - Is a cross-platform office software suite. ![Freeware][Freeware Icon]

Markdown Tools ![Awesome List][awesome-list Icon]
#

Archimedes - Native macOS Markdown editor geared toward mathematical writing with inline LaTeX support.
Edmund - Minimal, native macOS Markdown editor with live preview; works with your existing files, no vault. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon] ![Native App][Native Icon]
EME - Open-source Markdown editor with an interface like Chrome. ![Open-Source Software][OSS Icon]
iA Writer - Writing app with an emphasis on simplicity and design.
Imark - Open-source Markdown reader that stores your comments inside the document itself as HTML comments. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon] ![Native App][Native Icon]
LightPaper - Simple, beautiful, yet powerful text editor for your Mac.
MacDown - Open source Markdown editor for macOS with live preview and HTML/PDF export. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Marked 2 - This is the Markdown preview with an elegant and powerful set of tools for all writers.
MarkText - Next generation markdown editor, running on platforms of MacOS Windows and Linux. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
MarkViewer - Markdown viewer and editor for macOS with AI-assisted editing. ![Freeware][Freeware Icon]
Marp - Markdown presentation writer with cross-platform support. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Marxico - Delicate Markdown editor for Evernote. Reliable storage and sync.
MWeb - Pro Markdown writing, and static blog generator App.
Obsidian - A second brain, for you, forever.
Pixley Reader - Reader for Markdown specs, docs, and changelogs generated by AI tools. ![Open-Source Software][OSS Icon] ![App Store][app-store Icon]
Scratch - Lightweight, offline-first markdown notes app with WYSIWYG editing and local AI agent support. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Typora - Truly minimal Markdown editor featuring seamless live preview.
Ulysses - The Ultimate Writing App for Mac, iPad and iPhone.
Zettlr - A markdown editor for the 21st century. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]

Note-taking
#

Affine - Affine is the next-generation collaborative knowledge base for professionals. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Agenda - Date-focused note taking app for both planning and documenting your projects. ![App Store][app-store Icon]
Anytype - Local-first note-taking and knowledge management app. ![Freeware][Freeware Icon]
AppFlowy - Open-source alternative to Notion. ![Open-Source Software][OSS Icon] ![Freeware][Freeware Icon]
Bear Writer - Beautiful, flexible writing app for crafting notes and prose. ![App Store][app-store Icon]
Boostnote - Note-taking app made for programmers. ![Open-Source Software][OSS Icon]

…превью ограничено; полный список — в репозитории.

awesome-selfhosted

tools

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-selfhosted — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

Self-hosting is the practice of hosting and managing applications on your own server(s) instead of consuming from SaaSS providers.

This is a list of Free Software network services and web applications which can be hosted on your own server(s). Non-Free software is listed on the Non-Free page.

HTML version (recommended), Markdown version (legacy).

See Contributing.

Table of contents
#

Software
#

Analytics
#

^ back to top ^

Analytics is the systematic computational analysis of data or statistics. It is used for the discovery, interpretation, and communication of meaningful patterns in data.

ANALOG - A minimal analytics tool. Tracks events in a span of 10-30 days. MIT Nodejs/Docker
Aptabase - Privacy first and simple analytics for mobile and desktop apps. (Source Code) AGPL-3.0 Docker
AWStats - Generate statistics from web, streaming, ftp or mail server logfiles. (Demo, Source Code) GPL-3.0 Perl
Countly Community Edition - Real time mobile and web analytics, crash reporting and push notifications platform. (Source Code) AGPL-3.0 Nodejs/Docker
d8a.tech - A data collection service that works with your existing Google Analytics setup to capture user activity and send it straight to your own private database. (Demo, Source Code) MIT Go/Docker
Daily Stars Explorer ⚠ - Track GitHub repo trends with daily star insights to see growth and community interest over time. (Demo, Source Code) MIT Go/Nodejs/Docker
Druid - Distributed, column-oriented, real-time analytics data store. (Source Code) Apache-2.0 Java/Docker
EDA - Web application for data analysis and visualization. AGPL-3.0 Nodejs/Docker
GoAccess - Real-time web log analyzer and interactive viewer that runs in a terminal. (Source Code) GPL-2.0 C
GoatCounter - Easy web statistics without tracking of personal data. (Source Code) EUPL-1.2 Go
HitKeep - Privacy-first web analytics with goals, funnels, ecommerce tracking, and team management in a single binary with embedded DuckDB (alternative to Google Analytics, Plausible, Umami). (Source Code) MIT Go/Docker
Litlyx - All-in-one Analytics Solution. Setup in 30 seconds. Display all your data on an AI-powered dashboard. Fully self-hostable and GDPR compliant. (Source Code) Apache-2.0 Docker
Liwan - Privacy-first web analytics. (Demo, Source Code) Apache-2.0 Rust/Docker
Matomo - Web analytics that protects your data and your customers’ privacy (alternative to Google Analytics). (Source Code) GPL-3.0 PHP
Medama Analytics - Privacy-first website analytics. Tiny, simple, and cookie-free. (Demo, Source Code) Apache-2.0/MIT Docker/Go
Metabase - Easy way for everyone in your company to ask questions and learn from data. (Source Code) AGPL-3.0 Java/Docker
Middleware - Tool designed to help engineering leaders measure and analyze the effectiveness of their teams using the DORA metrics. (Source Code) Apache-2.0 Docker/Python/Nodejs
Netron - Visualizer for neural network and machine learning models. (Source Code) MIT Python/Nodejs
Offen - Fair, lightweight and open web analytics tool. Gain insights while your users have full access to their data. (Demo, Source Code) Apache-2.0 Go/Docker
Plausible Analytics - Simple, lightweight (< 1 KB) and privacy-friendly web analytics. (Source Code) AGPL-3.0 Elixir
PostHog - Product analytics, session recording, feature flagging and a/b testing that you can self-host (alternative to Mixpanel, Amplitude, Heap, HotJar, Optimizely). (Source Code) MIT Python
Postiz ⚠ - Schedule posts, track the performance of your content, and manage all your social media accounts in one place (Alternative to Buffer, Hootsuite, Sprout Social). (Source Code) AGPL-3.0 Docker
Prisme Analytics - Privacy-focused and progressive analytics service based on Grafana. (Source Code) AGPL-3.0/MIT Docker
Redash - Connect and query your data sources, build dashboards to visualize data and share them with your company. (Source Code) BSD-2-Clause Docker
Rybbit - Web and products analytics that is easy to setup and more intuitive (alternative to Google Analytics). (Demo, Source Code) AGPL-3.0 Docker
Shaper - Build Data Dashboards all in SQL. Powered by DuckDB. (Demo, Source Code) MPL-2.0 Docker/Nodejs/Python/Go
Socioboard ⚠ - Social media management, analytics, and reporting platform supporting nine social media networks out-of-the-box. GPL-3.0 Nodejs
Statistics for Strava ⚠ - Statistics dashboard generated from Strava data. (Demo) AGPL-3.0 Docker
Superset - Modern data exploration and visualization platform. (Source Code) Apache-2.0 Python
Swetrix - Ultimate, open-source web analytics to satisfy all your needs. (Demo, Source Code) AGPL-3.0 Docker
Umami - Simple, fast, privacy-focused alternative to Google Analytics. (Demo, Source Code) MIT Nodejs/Docker
Vince - Web analytics and dashboard (alternative to Google Analytics). (Source Code) AGPL-3.0 Go/Docker/K8S/deb

Archiving and Digital Preservation (DP)
#

^ back to top ^

Digital archiving and preservation software.

See also: awesome-web-archiving

ArchiveBox - Create HTML & screenshot archives of sites from your bookmarks, browsing history, RSS feeds, or other sources (alternative to Wayback Machine). (Demo, Source Code) MIT Python/Docker
ArchivesSpace - Archives information management application for managing and providing Web access to archives, manuscripts and digital objects. (Demo, Source Code) ECL-2.0 Ruby
Bichon - Email archiving server that syncs from IMAP accounts, indexes emails for full-text search, and provides a REST API. No external database required, includes WebUI with multi-account support. AGPL-3.0 Rust/Docker
bitmagnet - BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI, GraphQL API and Servarr stack integration. (Source Code) MIT Go/Docker
CKAN - Make open data websites. (Source Code) AGPL-3.0 Python
Collective Access - Providence - Highly configurable Web-based framework for management, description, and discovery of digital and physical collections supporting a variety of metadata standards, data types, and media formats. (Source Code) GPL-3.0 PHP
Eonvelope - Email archiving software that allows you to preserve your emails for an indefinite long period of time. (Source Code) AGPL-3.0 K8S/Docker
Ganymede ⚠ - Twitch VOD and live stream archiving platform. Includes a rendered chat for each archive. GPL-3.0 Docker
mail-archiver - Web application for archiving, searching, and exporting emails from multiple accounts (IMAP, M365 or Import). Featuring folder sync, attachment support, mailbox migration and a dashboard. GPL-3.0 Docker
Omeka S - Next-generation web publishing platform for institutions interested in connecting digital cultural heritage collections with other resources online. (Source Code) GPL-3.0 Nodejs
Open Archiver - Email archiving solution with full-text search and eDiscovery search features. (Demo, Source Code) AGPL-3.0 Docker
Piler - Feature-rich email archiving solution. (Source Code) GPL-3.0 C/Docker/deb
Wallabag - Wallabag, formerly Poche, is a web application allowing you to save articles to read them later with improved readability. (Source Code) MIT PHP
Wayback - A self-hosted toolkit for archiving webpages to the Internet Archive, archive.today, IPFS, and local file systems. GPL-3.0 Go

Automation
#

^ back to top ^

Automation software designed to reduce human intervention in processes.

Activepieces - No-code business automation tool like Zapier or Tray. For example, you can send a Slack notification for each new Trello card. (Source Code) MIT Docker
Apache Airflow - Platform to programmatically author, schedule, and monitor workflows. (Source Code) Apache-2.0 Python/Docker
Automatisch - Business automation tool that lets you connect different services like Twitter, Slack, and more to automate your business processes (alternative to Zapier). (Source Code) AGPL-3.0 Docker
BookBounty ⚠ - Retrieve missing Readarr books from Library Genesis. MPL-2.0 Docker
changedetection.io - Stay up-to-date with web-site content changes. (Source Code) Apache-2.0 Python/Docker
ChiefOnboarding - Employee onboarding platform that allows you to provision user accounts and create sequences with todo items, resources, text/email/Slack messages, and more! Available as a web portal and Slack bot. (Source Code) AGPL-3.0 Docker
Cronicle - Simple, distributed task scheduler and runner with a web based UI. (Source Code) MIT Nodejs
Cronmaster - Cronjob management UI with human readable syntax, live logging and log history for your cronjobs. AGPL-3.0 Docker
Dagu - Powerful Cron alternative with a Web UI. It allows you to define dependencies between commands as a Directed Acyclic Graph (DAG) in a declarative YAML format. (Source Code) GPL-3.0 Go/Docker
Discount Bandit ⚠ - Track pricing, stock status of products across multiple stores such as Amazon, Ebay, Walmart, etc. (Source Code) GPL-3.0 PHP/Docker
Dittofeed - Omni-channel customer engagement and messaging automation platform (alternative to Braze, Customer.io, Iterable). (Demo, Source Code) MIT Docker
feedmixer - Micro web service which takes a list of feed URLs and returns a new feed consisting of the most recent n entries from each given feed (returns Atom, RSS, or JSON). (Demo) WTFPL Python
flowctl - Self-service workflow execution platform with approvals, remote execution and scheduling. (Demo, Source Code) Apache-2.0 Go/Docker
Fredy ⚠ - Searches for new apartments, houses, and flats in Germany on platforms like ImmoScout24, Immowelt, and others, and instantly delivers the results to you via Slack, Telegram, and more. (Demo, Source Code) Apache-2.0 Nodejs/Docker
gocron - Task scheduler that allows users to specify recurring jobs via a simple YAML configuration file. MIT Docker
HandBrake Web - Use one or more instances of HandBrake video transcoder on a headless device via a web interface. AGPL-3.0 Docker
Healthchecks - Listen for pings and sends alerts when pings are late. (Source Code) BSD-3-Clause Python/Docker
HomeButler - Homelab management tool for monitoring hosts, Docker services, Wake-on-LAN, inventory, and remote operations, with a web dashboard and MCP integrations. (Source Code) MIT Docker/Go
Huginn - Build agents that monitor and act on your behalf. MIT Ruby
Kestra - Event-driven, language-agnostic platform to create, schedule, and monitor workflows. In code. Coordinate data pipelines and tasks such as ETL and ELT. (Source Code) Apache-2.0 Docker
Kibitzr - Lightweight personal web assistant with powerful integrations. (Source Code) MIT Python
LazyLibrarian ⚠ - Follow authors and grab metadata for all your digital reading needs. It uses a combination of Goodreads, Librarything and optionally GoogleBooks as sources for author info and book info. GPL-3.0 Python
Leon - Personal assistant who can live on your server. (Source Code) MIT Nodejs
Matchering - Automated music mastering (alternative to LANDR, eMastered and MajorDecibel). GPL-3.0 Docker
Mylar3 - Automated Comic Book (cbr/cbz) downloader program for use with NZB and torrents. (Source Code) GPL-3.0 Python/Docker
OliveTin - Web interface for running Linux shell commands. (Source Code) AGPL-3.0 Go
pyLoad - Lightweight, customizable and remotely manageable downloader for 1-click-hosting sites like rapidshare.com or uploaded.to. (Source Code) AGPL-3.0 Python
StackStorm - StackStorm (aka IFTTT for Ops) is event-driven automation for auto-remediation, security responses, troubleshooting, deployments, and more. Includes rules engine, workflow, 160 integration packs with 6000+ actions and ChatOps. (Source Code) Apache-2.0 Python
µTask - Automation engine that models and executes business processes declared in yaml. BSD-3-Clause Go/Docker

Backup
#

^ back to top ^

Backup software.

Please visit awesome-sysadmin/Backups

Blogging Platforms
#

^ back to top ^

A blog is a discussion or informational website consisting of discrete, diary-style text entries (posts).

See also: WeblogMatrix

Antville - Free, open source project aimed at the development of a high performance, feature rich weblog hosting software. (Source Code) Apache-2.0 Javascript
Castopod - Podcast management hosting platform that includes the latest podcast 2.0 standards, an automated Fediverse feed, analytics, an embeddable player, and more. (Source Code) AGPL-3.0 PHP/Docker
Chyrp Lite - Extra-awesome, extra-lightweight blog engine. (Source Code) BSD-3-Clause PHP
Dotclear - Take control over your blog. GPL-2.0 PHP
Ech0 - Lightweight federated publishing platform focused on personal idea sharing (documentation in Chinese). (Demo, Source Code) AGPL-3.0 Docker/K8S
FlatPress - A lightweight, easy-to-set-up flat-file blogging engine. (Source Code) GPL-2.0 PHP
fx - Micro-blog tool offering built-in syntax highlighting, mobile publishing and more (alternative to Twitter, Bluesky). MIT Docker
Ghost - Just a blogging platform. (Source Code) MIT Nodejs
Haven - Private blogging system with markdown editing and built in RSS reader. (Demo, Source Code) MIT Ruby
HTMLy - Databaseless PHP blogging platform. A flat-file CMS that allows you to create a fast, secure, and powerful website or blog in seconds. (Demo, Source Code) GPL-2.0 PHP

…превью ограничено; полный список — в репозитории.

the-book-of-secret-knowledge

tools

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: the-book-of-secret-knowledge — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

"Knowledge is powerful, be careful how you use it!"

A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web tools, and more.

:notebook_with_decorative_cover: What is it?
#

This repository is a collection of various materials and tools that I use every day in my work. It contains a lot of useful information gathered in one piece. It is an invaluable source of knowledge for me that I often look back on.

:restroom: For whom?
#

For everyone, really. Here everyone can find their favourite tastes. But to be perfectly honest, it is aimed towards System and Network administrators, DevOps, Pentesters, and Security Researchers.

:information_source: Contributing
#

If you find something which doesn’t make sense, or something doesn’t seem right, please make a pull request and please add valid and well-reasoned explanations about your changes or comments.

A few simple rules for this project:

inviting and clear
not tiring
useful

These below rules may be better:

easy to contribute to (Markdown + HTML …)
easy to find (simple TOC, maybe it’s worth extending them?)

Url marked * is temporary unavailable. Please don’t delete it without confirming that it has permanently expired.

Before adding a pull request, please see the contributing guidelines. You should also remember about this:

+ This repository is not meant to contain everything but only good quality stuff.

All suggestions/PR are welcome!

Code Contributors
#

This project exists thanks to all the people who contribute.

Financial Contributors
#

:newspaper: RSS Feed & Updates
#

GitHub exposes an RSS/Atom feed of the commits, which may also be useful if you want to be kept informed about all changes.

:ballot_box_with_check: ToDo
#

Add new stuff…
Add useful shell functions
Add one-liners for collection tools (eg. CLI Tools)
Sort order in lists

New items are also added on a regular basis.

:anger: Table of Contents
#

Only main chapters:

:trident: The Book of Secret Knowledge (Chapters)
#

CLI Tools ^[TOC]
#

:black_small_square: Shells
#

   GNU Bash - is an sh-compatible shell that incorporates useful features from the Korn shell and C shell.
   Zsh - is a shell designed for interactive use, although it is also a powerful scripting language.
   tclsh - is a very powerful cross-platform shell, suitable for a huge range of uses.
   bash-it - is a framework for using, developing and maintaining shell scripts and custom commands.
   Oh My ZSH! - is the best framework for managing your Zsh configuration.
   Oh My Fish - the Fishshell framework.
   Starship - the cross-shell prompt written in Rust.
   powerlevel10k - is a fast reimplementation of Powerlevel9k ZSH theme.

:black_small_square: Shell plugins
#

   z - tracks the folder you use the most and allow you to jump, without having to type the whole path.
   fzf - is a general-purpose command-line fuzzy finder.
   zsh-autosuggestions - Fish-like autosuggestions for Zsh.
   zsh-syntax-highlighting - Fish shell like syntax highlighting for Zsh.
   Awesome ZSH Plugins - A list of frameworks, plugins, themes and tutorials for ZSH.

:black_small_square: Managers
#

   Midnight Commander - is a visual file manager, licensed under GNU General Public License.
   ranger - is a VIM-inspired filemanager for the console.
   nnn - is a tiny, lightning fast, feature-packed file manager.
   screen - is a full-screen window manager that multiplexes a physical terminal.
   tmux - is a terminal multiplexer, lets you switch easily between several programs in one terminal.
   tmux-cssh - is a tool to set comfortable and easy to use functionality tmux-sessions.

:black_small_square: Text editors
#

   vi - is one of the most common text editors on Unix.
   vim - is a highly configurable text editor.
   emacs - is an extensible, customizable, free/libre text editor, and more.
   micro - is a modern and intuitive terminal-based text editor.
   neovim - is a free open source, powerful, extensible and usable code editor.
   spacemacs - a community-driven Emacs distribution.
   spacevim - a community-driven vim distribution.

:black_small_square: Files and directories
#

fd - is a simple, fast and user-friendly alternative to find.
ncdu - is an easy to use, fast disk usage analyzer.

:black_small_square: Network
#

   PuTTY - is an SSH and telnet client, developed originally by Simon Tatham.
   Mosh - is a SSH wrapper designed to keep a SSH session alive over a volatile connection.
   Eternal Terminal - enables mouse-scrolling and tmux commands inside the SSH session.
   nmap - is a free and open source (license) utility for network discovery and security auditing.
   zmap - is a fast single packet network scanner designed for Internet-wide network surveys.
   Rust Scan - to find all open ports faster than Nmap.
   masscan - is the fastest Internet port scanner, spews SYN packets asynchronously.
   pbscan - is a faster and more efficient stateless SYN scanner and banner grabber.
   hping - is a command-line oriented TCP/IP packet assembler/analyzer.
   mtr - is a tool that combines the functionality of the 'traceroute' and 'ping' programs in a single tool.
   mylg - utility which combines the functions of the different network probes in one diagnostic tool.
   netcat - utility which reads and writes data across network connections, using the TCP/IP protocol.
   socat - utility which transfers data between two objects.
   tcpdump - is a powerful command-line packet analyzer.
   tshark - is a tool that allows us to dump and analyze network traffic (wireshark cli).
   Termshark - is a simple terminal user-interface for tshark.
   ngrep - is like GNU grep applied to the network layer.
   netsniff-ng - is a Swiss army knife for your daily Linux network plumbing if you will.
   sockdump - dump unix domain socket traffic.
   stenographer - is a packet capture solution which aims to quickly spool all packets to disk.
   tcpterm - visualize packets in TUI.
   bmon - is a monitoring and debugging tool to capture networking related statistics and prepare them visually.
   iptraf-ng - is a console-based network monitoring program for Linux that displays information about IP traffic.
   vnstat - is a network traffic monitor for Linux and BSD.
   iPerf3 - is a tool for active measurements of the maximum achievable bandwidth on IP networks.
   ethr - is a Network Performance Measurement Tool for TCP, UDP & HTTP.
   Etherate - is a Linux CLI based Ethernet and MPLS traffic testing tool.
   echoip - is a IP address lookup service.
   Nemesis - packet manipulation CLI tool; craft and inject packets of several protocols.
   packetfu - a mid-level packet manipulation library for Ruby.
   Scapy - packet manipulation library; forge, send, decode, capture packets of a wide number of protocols.
   impacket - is a collection of Python classes for working with network protocols.
   ssh-audit - is a tool for SSH server auditing.
   aria2 - is a lightweight multi-protocol & multi-source command-line download utility.
   iptables-tracer - observe the path of packets through the iptables chains.
   inception - a highly configurable tool to check for whatever you like against any number of hosts.
   mRemoteNG - a fork of mRemote, multi-tabbed PuTTy on steroids!

:black_small_square: Network (DNS)
#

   dnsdiag - is a DNS diagnostics and performance measurement tools.
   fierce - is a DNS reconnaissance tool for locating non-contiguous IP space.
   subfinder - is a subdomain discovery tool that discovers valid subdomains for websites.
   sublist3r - is a fast subdomains enumeration tool for penetration testers.
   amass - is tool that obtains subdomain names by scraping data sources, crawling web archives, and more.
   namebench - provides personalized DNS server recommendations based on your browsing history.
   massdns - is a high-performance DNS stub resolver for bulk lookups and reconnaissance.
   knock - is a tool to enumerate subdomains on a target domain through a wordlist.
   dnsperf - DNS performance testing tools.
   dnscrypt-proxy 2 - a flexible DNS proxy, with support for encrypted DNS protocols.
   dnsdbq - API client providing access to passive DNS database systems.
   grimd - fast dns proxy, built to black-hole internet advertisements and malware servers.
   dnstwist - detect typosquatters, phishing attacks, fraud, and brand impersonation.

:black_small_square: Network (HTTP)
#

   curl - is a command line tool and library for transferring data with URLs.
   kurly - is an alternative to the widely popular curl program, written in Golang.
   HTTPie - is an user-friendly HTTP client.
   wuzz - is an interactive cli tool for HTTP inspection.
   h2spec - is a conformance testing tool for HTTP/2 implementation.
   h2t - is a simple tool to help sysadmins to hardening their websites.
   htrace.sh - is a simple Swiss Army knife for http/https troubleshooting and profiling.
   httpstat - is a tool that visualizes curl statistics in a way of beauty and clarity.
   httplab - is an interactive web server.
   Lynx - is a text browser for the World Wide Web.
   Browsh - is a fully interactive, real-time, and modern text-based browser.
   HeadlessBrowsers - a list of (almost) all headless web browsers in existence.
   ab - is a single-threaded command line tool for measuring the performance of HTTP web servers.
   siege - is an http load testing and benchmarking utility.
   wrk - is a modern HTTP benchmarking tool capable of generating significant load.
   wrk2 - is a constant throughput, correct latency recording variant of wrk.
   vegeta - is a constant throughput, correct latency recording variant of wrk.
   bombardier - is a fast cross-platform HTTP benchmarking tool written in Go.
   gobench - http/https load testing and benchmarking tool.
   hey - HTTP load generator, ApacheBench (ab) replacement, formerly known as rakyll/boom.
   boom - is a script you can use to quickly smoke-test your web app deployment.
   SlowHTTPTest - is a tool that simulates some Application Layer Denial of Service attacks by prolonging HTTP.
   gobuster - is a free and open source directory/file & DNS busting tool written in Go.
   ssllabs-scan - command-line reference-implementation client for SSL Labs APIs.
   http-observatory - Mozilla HTTP Observatory cli version.
   Hurl - is a command line tool to run and test HTTP requests with plain text.

:black_small_square: SSL
#

openssl - is a robust, commercial-grade, and full-featured toolkit for the TLS and SSL protocols.

…превью ограничено; полный список — в репозитории.

Разработка

2

awesome-nodejs

development

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-nodejs — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

^{My open source work is supported by the community}

^{Special thanks to:}

Fast remote container builds and GitHub Actions runners.

Get the most out of every conversation.

^{AI-powered meeting notes, automations, and search. Give AI agents the context they need to get things done.}

_{Just type node.cool to go here. Follow me on Twitter.}

Node.js is an open-source, cross-platform, JavaScript runtime for writing servers and command-line tools.

Contents
#

Official
#

Packages
#

Mad science
#

webtorrent - Streaming torrent client for Node.js and the browser.
peerflix - Streaming torrent client.
ipfs - Distributed file system that seeks to connect all computing devices with the same system of files.
stackgl - Open software ecosystem for WebGL, built on top of browserify and npm.
peerwiki - All of Wikipedia on BitTorrent.
peercast - Stream a torrent video to Chromecast.
BitcoinJS - Clean, readable, proven Bitcoin library.
Bitcore - Pure and powerful Bitcoin library.
PDFKit - PDF generation library.
turf - Modular geospatial processing and analysis engine.
webcat - p2p pipe across the web using WebRTC that uses your GitHub private/public key for authentication.
NodeOS - The first operating system powered by npm.
YodaOS - AI operating system.
Brain.js - Machine-learning framework.
Pipcook - Front-end algorithm framework to create a machine learning pipeline.
Cytoscape.js - Graph theory (a.k.a. network) modeling and analysis.
js-git - JavaScript implementation of Git.
xlsx - Pure JS Excel spreadsheet reader and writer.
isomorphic-git - Pure JavaScript implementation of Git.

Command-line apps
#

np - Better npm publish.
npm-name - Check a package name’s availability on npm.
gh-home - Open the GitHub page of the repo in the current directory.
npm-home - Open the npm page of a package.
trash - Safer alternative to rm.
speed-test - Test your internet connection speed and ping.
pageres - Capture website screenshots.
cpy - Copy files.
vtop - More better top, with nice charts.
empty-trash - Empty the trash.
is-up - Check whether a website is up or down.
is-online - Check if the internet connection is up.
public-ip - Get your public IP address.
clipboard-cli - Copy & paste on the terminal.
XO - Enforce strict code style using the JavaScript happiness style.
ESLint - The pluggable linting utility for JavaScript.
David - Tells you when your package npm dependencies are out of date.
http-server - Simple, zero-config command-line HTTP server.
Live Server - Development HTTP-server with livereload capability.
bcat - Pipe command output to web browsers.
normit - Google Translate with speech synthesis in your terminal.
fkill - Fabulously kill processes. Cross-platform.
pjs - Pipeable JavaScript. Quickly filter, map, and reduce from the terminal.
license-checker - Check licenses of your app’s dependencies.
browser-run - Easily run code in a browser environment.
tmpin - Adds stdin support to any CLI app that accepts file input.
wallpaper - Change the desktop wallpaper.
pen - Live Markdown preview in the browser from your favorite editor.
dark-mode - Toggle the macOS Dark Mode.
Jsome - Pretty prints JSON with configurable colors and indentation.
mobicon - Mobile app icon generator.
mobisplash - Mobile app splash screen generator.
diff2html-cli - Pretty git diff to HTML generator.
trymodule - Try out npm packages in the terminal.
jscpd - Copy/paste detector for source code.
atmo - Server-side API mocking.
auto-install - Auto installs dependencies as you code.
cost-of-modules - Find out which dependencies are slowing you down.
localtunnel - Expose your localhost to the world.
svg-term-cli - Share terminal sessions via SVG.
gtop - System monitoring dashboard for the terminal.
themer - Generate themes for your editor, terminal, wallpaper, Slack, and more.
carbon-now-cli - Beautiful images of your code — from right inside your terminal.
cash-cli - Convert between 170 currencies.
taskbook - Tasks, boards & notes for the command-line habitat.
discharge - Easily deploy static websites to Amazon S3.
npkill - Easily find and remove old and heavy node_modules folders.

Functional programming
#

lodash - Utility library delivering consistency, customization, performance, & extras. A better and faster Underscore.js.
immutable - Immutable data collections.
Ramda - Utility library with a focus on flexible functional composition enabled by automatic currying and reversed argument order. Avoids mutating data.
Mout - Utility library with the biggest difference between other existing solutions is that you can choose to load only the modules/functions that you need, no extra overhead.
RxJS - Functional reactive library for transforming, composing, and querying various kinds of data.
Kefir.js - Reactive library with focus on high performance and low memory usage.

HTTP
#

got - Nicer interface to the built-in http module.
undici - High performance HTTP client written from scratch with zero dependencies.
ky-universal - Universal HTTP client based on Fetch.
node-fetch - window.fetch for Node.js.
axios - Promise based HTTP client (works in the browser too).
superagent - HTTP request library.
http-fake-backend - Build a fake backend by providing the content of JSON files or JavaScript objects through configurable routes.
cacheable-request - Wrap native HTTP requests with RFC compliant cache support.
gotql - GraphQL request library built on got.
global-agent - Global HTTP/HTTPS proxy agent that is configurable using environment variables.
smoke - File-based HTTP mock server with recording abilities.
purest - REST client.

Debugging / Profiling
#

debug - Tiny debugging utility.
why-is-node-running - Node.js is running but you don’t know why?
njsTrace - Instrument and trace your code, see all function calls, arguments, return values, as well as the time spent in each function.
vstream - Instrumentable streams mix-ins to inspect a pipeline of streams.
stackman - Enhance an error stacktrace with code excerpts and other goodies.
locus - Starts a REPL at runtime that has access to all variables.
0x - Flamegraph profiling.
ctrace - Well-formatted and improved trace system calls and signals.
leakage - Write memory leak tests.
llnode - Post-mortem analysis tool which allows you to inspect objects and get insights from a crashed Node.js process.
thetool - Capture different CPU, memory, and other profiles for your app in Chrome DevTools friendly format.
swagger-stats - Trace API calls and monitor API performance, health, and usage metrics.
NiM - Manages DevTools debugging workflow.
dats - Minimalistic and zero-dependencies StatsD client.

Logging
#

pino - Extremely fast logger inspired by Bunyan.
winston - Multi-transport async logging library.
console-log-level - The most simple logger imaginable with support for log levels and custom prefixes.

…превью ограничено; полный список — в репозитории.

awesome-python

development

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: awesome-python — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

An opinionated guide to the best Python frameworks, libraries, and tools.

Visit the website to search and filter projects more easily.

Sponsors
#

The #10 most-starred repo on GitHub. Put your product in front of Python developers. Become a sponsor.

Categories
#

AI & ML

Web Development

HTTP & Scraping

Database & Storage

Data & Science

Developer Tools

DevOps

CLI & GUI

Text & Documents

Media

Python Language

Python Toolchain

Security

Other

Projects
#

AI & ML

AI and Agents
#

Libraries for building AI applications, LLM integrations, and autonomous agents.

Agent Skills
- django-ai-plugins - Django backend agent skills for Django, DRF, Celery, and Django-specific code review.
- sentry-skills - Python-focused engineering skills for code review, debugging, and backend workflows.
- trailofbits-skills - Python-friendly security skills for auditing, testing, and safer backend development.
Orchestration
- langchain - Building applications with LLMs through composability.
- langgraph - Low-level orchestration framework for building stateful, long-running LLM agents.
- crewai - A framework for orchestrating role-playing autonomous AI agents for collaborative task solving.
- pydantic-ai - A Python agent framework for building generative AI applications with structured schemas.
Vendor Agent SDKs
- openai-agents - OpenAI’s framework for building and managing AI agents.
- claude-agent-sdk - Anthropic’s Python SDK for building AI agents on Claude Code’s harness — custom tools, in-process MCP servers, hooks.
Personal Assistants
- hermes-agent - An adaptive personal AI assistant that grows with you.
Prompt Optimization
- dspy - A framework for programming, not prompting, language models.
Data Layer
- instructor - A library for extracting structured data from LLMs, powered by Pydantic.
- llama-index - A data framework for your LLM application.
- mem0 - An intelligent memory layer for AI agents enabling personalized interactions.
Pre-trained Models
- transformers - A framework that lets you easily use pre-trained transformer models for NLP, vision, and audio tasks.
LLM Inference and Serving
- sglang - A high-performance serving framework for large language models and multimodal models.
- vllm - A high-throughput and memory-efficient inference and serving engine for LLMs.
- mlx-lm - Run and fine-tune large language models on Apple Silicon with MLX.
LLM Gateways
- LiteLLM - Call 100+ LLMs using OpenAI format.
Image and Video Generation
- diffusers - A library that provides pre-trained diffusion models for generating and editing images, audio, and video.
Fine-tuning
- unsloth - A library for faster LLM fine-tuning and training with reduced memory usage.
Speech
- openai-whisper - A general-purpose automatic speech recognition model trained on 680k hours of multilingual and multitask supervised data.
- funasr - Industrial-grade speech recognition toolkit with 170x realtime speed, 50+ languages, speaker diarization, and emotion detection.
- vibevoice - A family of open-source voice AI models from Microsoft for text-to-speech and long-form speech recognition.
- gTTS - Python library and CLI tool for converting text to speech using Google Translate TTS.
- kittentts - Lightweight ONNX text-to-speech library with small CPU-friendly models.

Deep Learning
#

Frameworks for Neural Networks and Deep Learning. Also see awesome-deep-learning.

Frameworks
- pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration.
- tensorflow - The most popular Deep Learning framework created by Google.
- keras - A high-level deep learning library with support for JAX, TensorFlow, and PyTorch backends.
- jax - A library for high-performance numerical computing with automatic differentiation and JIT compilation.
- pytorch-lightning - Deep learning framework to train, deploy, and ship AI products Lightning fast.
Reinforcement Learning
- gymnasium - A standard API for reinforcement learning environments with popular reference environments (gym successor).
- stable-baselines3 - PyTorch implementations of Stable Baselines (deep) reinforcement learning algorithms.

Machine Learning
#

Libraries for Machine Learning. Also see awesome-machine-learning.

General
- scikit-learn - The most popular Python library for Machine Learning with extensive documentation and community support.
- pgmpy - A Python library for probabilistic graphical models and Bayesian networks.
- feature-engine - sklearn compatible API with the widest toolset for feature engineering and selection.
Gradient Boosting
- xgboost - A scalable, portable, and distributed gradient boosting library.
- lightgbm - A fast, distributed, high performance gradient boosting framework.
- catboost - A fast, scalable, high performance gradient boosting on decision trees library.
Time Series Forecasting
- timesfm - A pretrained foundation model from Google Research for time-series forecasting.

Natural Language Processing
#

Libraries for working with human languages.

General
- nltk - A leading platform for building Python programs to work with human language data.
- spacy - A library for industrial-strength natural language processing in Python and Cython.
- gensim - Topic Modeling for Humans.
- stanza - The Stanford NLP Group’s official Python library, supporting 60+ languages.
Chinese
- jieba - The most popular Chinese text segmentation library.
- pypinyin - Convert Chinese hanzi (漢字) to pinyin (拼音).
- pangu.py - Paranoid text spacing.

Computer Vision
#

Libraries for Computer Vision.

General
- opencv-python - Open Source Computer Vision Library.
- ultralytics - Ultralytics YOLO for object detection, segmentation, pose estimation, and classification with state-of-the-art accuracy and speed.
- kornia - Open Source Differentiable Computer Vision Library for PyTorch.
- fiftyone - The open-source tool for building high-quality datasets and computer vision models.
OCR
- pytesseract - A wrapper for Google Tesseract OCR.
- easyocr - Ready-to-use OCR with 40+ languages supported.

Recommender Systems
#

Libraries for building recommender systems.

annoy - Approximate Nearest Neighbors in C++/Python optimized for memory usage.
implicit - A fast Python implementation of collaborative filtering for implicit datasets.
scikit-surprise - A scikit for building and analyzing recommender systems.

Web Development

Web Frameworks
#

Traditional full stack web frameworks. Also see Web APIs.

Synchronous
- flask - A microframework for Python.
  - awesome-flask
- django - The most popular web framework in Python.
  - awesome-django
- bottle - A fast and simple micro-framework distributed as a single file with no dependencies.
- pyramid - A small, fast, down-to-earth, open source Python web framework.
  - awesome-pyramid
- fasthtml - The fastest way to create an HTML app.
  - awesome-fasthtml
Asynchronous
- starlette - A lightweight ASGI framework and toolkit for building high-performance async services.
- tornado - A web framework and asynchronous networking library.
- litestar - Production-ready, capable and extensible ASGI Web framework.
- reflex - A framework for building reactive, full-stack web applications entirely with Python.

…превью ограничено; полный список — в репозитории.

Системы & Языки

1

papers-we-love

systems

★ Репозиторий README ↗ Превью →

показать превью списка

Источник: papers-we-love — синхронизируется из внешнего репозитория как sparse-субмодуль (только список).

#

Papers We Love (PWL) is a community built around reading, discussing and learning more about academic computer science papers. This repository serves as a directory of some of the best papers the community can find, bringing together documents scattered across the web. You can also visit the Papers We Love site for more info.

Due to licenses we cannot always host the papers themselves (when we do, you will see a :scroll: emoji next to its title in the directory README) but we can provide links to their locations.

If you enjoy the papers, perhaps stop by a local chapter meetup and join in on the vibrant discussions around them. You can also discuss PWL events, the content in this repository, and/or anything related to PWL on our Discord server.

Chapters
#

Let us know if you are interested in starting one in your city!

All of our meetups follow our Code of Conduct.

Past Presentations
#

Check out our YouTube channel for videos and video playlists.

Info
#

We’re looking for pull requests related to papers we should add, better organization of the papers we do have, and/or links to other paper-repos we should point to.

Other Good Places to Find Papers
#

2 Minute Papers
alphaXiv (Adds a discussion layer; replace “arxiv” with “alphaxiv” in an arXiv paper URL)
arXiv Paper Repository
Bell System Technical Journal, 1922-1983
Best Paper Awards in Computer Science
cat-v.org
eugeneyan/applied-ml GitHub repository
Facebook
Functional Programming Books Review
Google Scholar (choose a subcategory)
Gradual Typing Bibliography
Lobste.rs tagged as PDF
Microsoft Research
MIT’s Artificial Intelligence Lab Publications
MIT’s Distributed System’s Reading Group
netlib
Readings in Distributed Systems
Research Papers from Robert Harper, Carnegie Mellon University
SciRate
Security Data Science Papers
Services Engineering Reading List
The Morning Paper
y-archive

Please check out our wiki-page for links to blogs, books, exchanges that are worth a good read.

How To Read a Paper
#

Reading a paper is not the same as reading a blogpost or a novel. Here are a few handy resources to help you get started.

Applications/Ideas built around Papers We Love
#

Love a Paper - @loveapaper

Download papers
#

Open your favourite terminal and run:

$ ./scripts/download.sh

This will scrape markdown files for links to PDFs and download papers to their respective directories.

See README.md for more options.

Contributing Guidelines
#

Please take a look at our CONTRIBUTING.md file.

Copyright
#

The name “Papers We Love” and the logos for the organization are copyrighted, and under the ownership of Papers We Love Ltd, all rights reserved. When starting a chapter, please review our guidelines and ask us about using the logo.

DevOps & Инфраструктура

Awesome-Kubernetes#

What is Kubernetes?#

History#

Date of Birth#

Roadmap#

Featured On#

Starting Point#

Contributing#

License#

Contents#

Resources#

Learning#

Discovery#

Installation Media#

Channel History#

Deployment Tools#

Virtualisation#

Command-Line Tools#

Development#

DevOps#

Programming Languages#

Arduino#

Clojure#

Crystal#

Elixir#

Elm#

Gleam#

Haskell#

Haxe#

Julia#

Lean#

Node.js#

Web & Frontend

Appearance#

Architecture#

Compatibility#

Ecosystem#

Languages, Protocols, Browser APIs#

User Interface Components#

Workflow#

License#

Безопасность

Network#

Network architecture#

Scanning / Pentesting#

Monitoring / Logging#

IDS / IPS / Host IDS / Host IPS#

Honey Pot / Honey Net#

Full Packet Capture / Forensic#

Sniffer#

Security Information & Event Management#

VPN#

Fast Packet Processing#

Firewall#

Anti-Spam#

Docker Images for Penetration Testing & Security#

Endpoint#

Anti-Virus / Anti-Malware#

Content Disarm & Reconstruct#

Configuration Management#

Authentication#

Mobile / Android / iOS#

Forensics#

Блокчейн & DAO

Contents#

Frequently Asked Questions (F.A.Q.s) & Answers#

Basic Introduction#

Development Tutorial#

Данные & ML

IMPORTANT NOTE ON PRs:#

Star History#

Table of Contents#

Frameworks and Libraries#

APL#

General-Purpose Machine Learning#

C#

General-Purpose Machine Learning#

Computer Vision#

Speech Recognition#

Awesome-Kubernetes
#

What is Kubernetes?
#

History
#

Date of Birth
#

Roadmap
#

Featured On
#

Starting Point
#

Contributing
#

License
#

Contents
#

Resources
#

Learning
#

Discovery
#

Installation Media
#

Channel History
#

Deployment Tools
#

Virtualisation
#

Command-Line Tools
#

Development
#

DevOps
#

Programming Languages
#

Arduino
#

Clojure
#

Crystal
#

Elixir
#

Elm
#

Gleam
#

Haskell
#

Haxe
#

Julia
#

Lean
#

Node.js
#

Appearance
#

Architecture
#

Compatibility
#

Ecosystem
#

Languages, Protocols, Browser APIs
#

User Interface Components
#

Workflow
#

License
#

Network
#

Network architecture
#

Scanning / Pentesting
#

Monitoring / Logging
#

IDS / IPS / Host IDS / Host IPS
#

Honey Pot / Honey Net
#

Full Packet Capture / Forensic
#

Sniffer
#

Security Information & Event Management
#

VPN
#

Fast Packet Processing
#

Firewall
#

Anti-Spam
#

Docker Images for Penetration Testing & Security
#

Endpoint
#

Anti-Virus / Anti-Malware
#

Content Disarm & Reconstruct
#

Configuration Management
#

Authentication
#

Mobile / Android / iOS
#

Forensics
#

Contents
#

Frequently Asked Questions (F.A.Q.s) & Answers
#

Basic Introduction
#

Development Tutorial
#

IMPORTANT NOTE ON PRs:
#

Star History
#

Table of Contents
#

Frameworks and Libraries
#

APL
#

General-Purpose Machine Learning
#

C
#

General-Purpose Machine Learning
#

Computer Vision
#

Speech Recognition
#

C++
#

Computer Vision
#

General-Purpose Machine Learning
#

Contents
#

Actor Model
#