Random things
To investigate
Server sent events (https://www.youtube.com/watch?v=8-PxeTgTx6s).
Splash - A javascript rendering service.
The Unofficial Guide to Rich Hickey's Brain
Kubernetes
HTML parsing
Replace tags and more:
http://w3lib.readthedocs.io/en/latest/w3lib.html
Python batteries
textract - extract text from pdf, odt, csv, etc.
Python dictionaries validation
Schema validation
validictory - general purpose python data validator
Exceptions
Do you keep an endpoint on your site that purposely causes an exception to test changes to
exception handling? Asking for a friend.Mark Roddy @digitallogic
Naming conventions
Compound names: "from less specific to more specific" works best in the most cases.
Directed acyclic graph
Directed acyclic graph (DAG) is a finite directed graph with no directed cycles. That is, it consists of finitely many vertices and edges, with each edge directed from one vertex to another, such that there is no way to start at any vertex v and follow a consistently-directed sequence of edges that eventually loops back to v again. Equivalently, a DAG is a directed graph that has a topological ordering, a sequence of the vertices such that every edge is directed from earlier to later in the sequence.
See airflow.
Shifts in software engineering
The cloud has effectively knocked down the logistical and economic barriers to
accessing production-ready infrastructure. Any organization or individual can
now harness the same technologies powering some of the biggest companies in
the world (Monitoring Modern Infrastructure by John Matson and K Young).
Hard disk mean time to failure
~ 10-50 years.
Encoding
Aka serialization, marshalling.
Translation from in-memory representation to byte sequence.
Decoding
Aka parsing, deserialization, unmarshaling.
Translation from bytes representation to in-memory representation.
SSH port forwarding
If I need to access ES installed on a server, from my laptop:
ssh -L 9201:localhost:9200 <server user>@<server ip>
Port 9200 from my server will be available locally as port 9201.
Vocabulary
Air-Gapped
Air-Gapped – Completely disconnected from any network.