/tech

Primary LanguageHTML

html

Technology-Note

Mind Map

CLI program

  • curl
  • httpie

Python

Hardware related

  • uPython (MicroPython/ CircuitPython)
  • Pyserial
  • smbus2: I2C framework

Network

  • paho-mqtt: Eclipse Paho MQTT Python client library

Developtools

  • Fire: automatically generate CLIs (command-line interfaces)
  • Cython
  • ipython
  • JupyterLab
  • venv
  • Poetry
  • pprint: pretty print with json
  • datetime
  • Arrow: works with dates and times
  • Delorean: python library for enhancing DateTime

Finance

Media

Image and Video

  • OpenCV : insall
  • PIL
  • SciKit-Image
  • Piddle: A Python Graphics API
  • Luminoth: dedicated for computer vision
  • Mahotas: Python image processing library

Audio

  • Pydub: Manipulate audio with a simple and easy high level interface.

Files

  • ReportLab: An Open Source Python library for generating PDFs and graphics.
  • python-pptx: Python library for creating and updating PowerPoint (.pptx) files
  • FlashText: offers easy search and replacement of words from documents

Web

Database

  • pymongo
  • sqlite
  • SQLAlchemy: Database Abstraction Library for Python

Web scraping

  • Beautiful Soup
  • Selenium
  • Scrapy: A Fast and Powerful Scraping and Web Crawling framework

Gaming and 3D

  • Panda3D
  • Renpy
  • Bigworld
  • Traits & TraitsUI
  • PyGame

Machine Learning / Big Data / Scientific Calculation

Basic Math

  • NumPy
  • SciPy
  • SymPy
  • Pandas
  • Theano
  • GeoPandas: GDF, extends the datatypes used by pandas to allow spatial operations on geometric types

Vis Tool

  • Matplotlib
  • TVTK & Mayavi : Visualization Toolkit.
  • handcalcs: Python calculations in Jupyter, as though you wrote them by hand
  • Plotly
  • Bokeh
  • mindmap

ML Package

  • Scikit-Learn
  • AutoSklearn: is an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.
  • statsmodel
  • sktime: a Unified Python Library for Time Series Machine Learning
  • pmdarima: similarly to R’s well-known auto.arima as possible
  • arch: ARCH, GARCH model - Github
  • PyFlux

NN Package

  • Tensorflow
  • Keras
  • PyTorch
  • PySpark
  • AutoKeras: An AutoML system based on Keras

AI Package (NLP, Reinforcement Learning)

  • NLTK: Natural language toolkit
  • Gensim: python natural library processing library
  • TextBlob: most simplified Python NLP libraries – for textual data processing
  • XGBoost
  • LightGBM

Parallel/Efficient Computing

Graph

  • Deep Graph
  • PyGraph Geometry
  • Spark GrapheFrame

Other

  • Cirq: noisy intermediate-scale quantum (NISQ) circuits
  • NetworkX: immense solutions for studying and diagnosing graphs of all levels

Markdown

Web Tech

Javascript

Graphic / AIML

IoT Hardware related

Advanced JS

  • TypeScript: Typed JavaScript at Any Scale.
  • Node.js: JavaScript runtime built on Chrome's V8 JavaScript engine.
  • Deno: simple, modern and secure runtime for JavaScript and TypeScript that uses V8 and is built in Rust

Interesting

Web Framework

Web API

Web Tools

Programming language

  • Protocol buffers: language-neutral, platform-neutral extensible mechanism for serializing structured data.
  • Python / uPython
  • JavaScript
  • Java
  • C/C++/Arduino
  • WebAssembly
  • Emscripten: a toolchain for compiling to asm.js and WebAssembly, built using LLVM, that lets you run C and C++ on the web at near-native speed without plugins
  • C#
  • Dart: a client-optimized language for fast apps on any platform.
  • TypeScript: Typed JavaScript at Any Scale.
  • Go: Open source programming language that makes it easy to build simple, reliable, and efficient software.
  • Swift: A powerful and intuitive programming language for macOS, iOS, watchOS, tvOS and beyond
  • Kotlin: A modern programming language that makes developers happier.
  • Julia: A fresh approach to technical computing.
  • Scala : combines object-oriented and functional programming in one concise, high-level language.
  • Processing, p5.js, Processing.py, Processing for Android/Pi
  • Perl: highly capable, feature-rich programming language with over 30 years of development.
  • Rust: A language empowering everyone to build reliable and efficient software.
  • Matlab/Octave
  • R: Free software environment for statistical computing and graphics.
  • Lua: powerful, efficient, lightweight, embeddable scripting language.
  • HTML :-)
  • PHP
  • SQL
  • VB 6/ VB.NET
  • PowerShell, Bat
  • Bash / Shell script
  • Assembly language
  • AHK: AutoHotkey, Free keyboard macro program
  • .Net
  • Chapel: Parallel Programming Language
  • NESL: A Parallel Programming Language
  • OpenACC

Encode/Decode Format

Database

Key-value (Fast No Queries)

  • Reddis
  • memcached
  • etcd

Wide Column (Schema-less, Without joins)

  • Apache HBase
  • cassandra

Document (Schema-less, Relational-ish queries, without joins)

  • MongoDB
  • Firestore
  • DynamoDB
  • Apache CouchDB

Relational

  • MySQL
  • PostgreSQL
  • SQL server
  • CockroachDB

Graph

  • Graph DB Benefit
  • neo4j
  • dgraph
  • Microsoft Azure Cosmos DB
  • JanusGraph

Search

  • Alpache Lucene
  • Elastic Search
  • Solr
  • Algolia
  • Meili Search

Multi-Model

  • FaunaDB

newer db

TimescaleDB is the leading open-source relational database for time-series data. Fully managed or self‑hosted. https://www.timescale.com/

Apache Cassandra: Manage massive amounts of data, fast, without losing sleep https://cassandra.apache.org/

PostgreSQL: The World's Most Advanced Open Source Relational Database https://www.postgresql.org/ https://towardsdatascience.com/python-and-postgresql-how-to-access-a-postgresql-database-like-a-data-scientist-b5a9c5a0ea43

NoSQL

ScyllaDB: The Real-Time Big Data Database https://www.scylladb.com/

Hardware

Board

  • Arduino: Uno, Nano, Micro, Due, Yun, MKR, Nano 33, Leonardo | AVR, ARM Cortex-M
  • Espressif: ESP32, ESP8266, ESP01 | Tensilica Xtensa by Cadence
  • Espressif: ESP32-C3 | RISC-V
  • BBC micro:bit | ARM Cortex-M
  • Raspberry Pi: 4/3/Zero W/CM | ARM Cortex-A
  • Orange Pi: Chinese SBC | ARM Cortex-A
  • Banana Pi: Chinese SBC | ARM Cortex-A
  • Sony spresense
  • Teensy USB Development Board
  • T-FireFly: Server, Computer, Accelerator | GPU
  • iEiworld: ODM | GPU

Chip/ Manufacturer

  • ARM: Cortex-A/R/M
  • STMicroelectronics: STM32/STM8/SPC5 - W/L/F/G/H/MP (CubeMX)| ARM Cortex-M/A
  • Microchip Atmel: ATMega, ATTiny, PIC24, SAMD| PIC/AVR/MIPS32/ARM Cortex-M/A
  • Nordic Semiconductor: nRF BT, Zigbee | ARM Cortex-M
  • NXP: i.MX | ARM
  • Texas Instruments: MSP430 CC2541 | ARM
  • Digi: Xbee, IoT | ARM
  • Rockchip: China MPU company | Cortex-A
  • Allwinner: China MPU company | Cortex-A
  • Broadcom: BCM2711 | Cortex-A
  • Nuvoton Technology: Taiwan Chip, M23, M0, M4, IoT | Cortex-A/M
  • Cypress: A lot
  • Future Technology Devices International: FTDI, USB related stuff
  • Bridgetek: BRT FT Series

FPGA

  • Alchitry:Introduction to Digital Electronics and FPGAs
  • xilinx: Industrial FPGA
  • Intel FPGA (Altera): Stratix、Arria, Cyclone

AI-Specific

  • 2018 全球 AI 晶⽚廠商產品⽐較表
  • Sipeed: AIoT enabler, k210 module | RISC-V, KPU
  • Canaan Kendryte k210 | RISC-V, KPU
  • Jetson: Nano, TX2, Xavier, AGX | Nvidia CUDA® cores, GPU
  • Google Coral: Edge TPU, USB Accelerator | TPU
  • Qualcomm: Snapdragon, smartphone SOC, Wearable | Cortex-A
  • MediaTek: MTK, Smartphone, cellular | Cortex-A
  • Micron: Memory, Storage
  • Intel Movidius: Myriad™ X, USB Accelerator | VPU
  • Gyrfalcon tech: Lightspeeur 5801 NEURAL ACCELERATOR | VPU
  • Graphcore : Intelligence Processing Unit | IPU
  • Cambricon : Chinese companies and startups working on AI chips
  • kneron : ON-DEVICE EDGE AI
  • NovuMind, vimicro, eyemore, westwell-lab, nationalchip, unisound, chipintelli, hxgpt: Chinese
  • 阿里平頭哥半導體有限公司 (T-Head), 小米 南京大魚半導體, Huami Huangshan
  • ARM project trillium: Arm ML processor and Arm OD processor

AI-CAM

IoT-Specific

  • Onion – Compute Platform for IoT special WEBOS
  • Pycom - Next Generation Internet of Things Platform
  • Particle.io: Build powerful edge solutions
  • u-blox: IIoT module
  • SIMCOM: 5G/NBIOT/IIoT module
  • EByte: Chinese LPWAN module
  • Ai-thinker: LPWAN module
  • quectel:

Intel

  • CPU: Xeon, Core ix, Atom
  • GPU: Xe
  • FPGA: Stratix 10
  • Dedicated: Movidius, Habana(Goya, Gaudi)
  • Kernel: DL Boost, DAAL, MKL-DNN, MKL
  • Graph: Plaid ML, nGraph
  • Developer Tools: OpenVINO

STEAM

  • SparkFun: Sensor, IoT, Apollo3 Blue
  • SeeedStudio: Sensor, IoT, Grove
  • Adafruit: Unique & fun DIY electronics and kits
  • Stemtera: SMART BREADBOARD
  • Scrappy Circuits: scrappy way to learn about electrical circuits
  • XinaBox.cc
  • Coxana: Snap IoT
  • Makeblock: Hardware Programming
  • Sphero/littlebits: Programmable Toy/Snap Hardware
  • Codejumper: Teaches students who are blind or visually impaired computer coding
  • Kano: DIY PC for kids

Conductive Ink

  • Bare Conductive
  • AgIC Inc.
  • Circuit Scribe: Draw Circuits Instantly
  • Paper Circuit

PCB Tools

IoT Platform

  • ThingsBoard: Open-source IoT Platform
  • ResIoT.io
  • The Things Network: LoRaWAN
  • Zerynth: Platform designed to simplify and accelerate the development of IoT applications
  • ThingSpeak: Open IoT platform with MATLAB analytics.
  • OneNet (by CMHK)
  • QQ IoT
  • Huaiwai OceanConnect
  • Nokia IMPACT
  • MS Azure
  • AWS IoT platform
  • IBM Waston IoT
  • Google Cloud IoT
  • IFTTT: Every thing works better together
  • iotivity
  • KMC controls

Edge Computing

  • KubeEdge
  • OpenFog
  • EdgeX Foundry
  • IIC: Industrial Internet Consortium
  • FogHorn Edge analytics platform
  • OpenRAN
  • vRAN

Big Company

  • FogHorn
  • Losant
  • Litmus automation
  • PTC

IoT Operator

  • Thingsmobile: Things Mobile: The best IOT and M2M SIM Card in the world
  • Thinxtra: OPERATING THE FIRST NATIONWIDE INTERNET OF THINGS NETWORK, BASED ON SIGFOX TECHNOLOGY
  • Pixel Networks
  • OrbiWAN
  • The Things Network: Building a global open LoRaWAN™ network
  • Chirp Stack: open-source LoRaWAN® Network Server stack

Micro OS

  • ARM mbed OS
  • Contiki OS
  • Zephyr
  • Zerynth
  • Embedded Linux
  • OpenWRT
  • FreeRTOS
  • uC/OS
  • Android Things
  • RT-Thread
  • Ostro
  • Huawei LiteOS
  • Mongoose-os
  • uPython
  • microROS

Communication Channel

LoWPAN

  • Bluetooth Low Energy
  • ZigBee
  • 6LoWPAN
  • WirelessHART

LoWLAN

  • Wi-Fi HaLow

WLAN

  • Wi-Fi

LPWAN: Low Power WAN

  • LTE-M (Long-term evolution for machine type communications)
  • NB-IoT (Narrowband IoT)
  • EC-GSM-IoT (extended coverage GSM IoT)
  • LoRa
  • SIGFOX

WWAN: Wireless Wide Area Network

  • GSM-based mobile networks (2G)
  • UMTS-based mobile networks (3G)
  • LTE-advanced based mobile networks (4G)

EH-based Network

  • EnOcean
  • ZigBee PRO with Green Power
  • Bluetooth LE

IIoT

  • CAN bus
  • EtherCAT
  • PROFINET
  • Ethernet/IP
  • Modbus
  • POWERLINK
  • Modbus
  • BACnet: Youtube |BACnet Stack |bacnet |bacnet International

Program/Service

Development Tools

  • hterm
  • RPA uipath
  • mouse recorder
  • wireshark
  • PuTTY
  • AutoHotKey
  • Temper monkey
  • VMware
  • Cypress.io

Desktop Tools / plugins

  • Octotree: GitHub on steroids
  • etcher
  • Deskpin
  • mouse recorder
  • AutoHotKey
  • Temper monkey

Online Editor/Editor

  • Glitch: Online web editor
  • Observable: magic notebook for exploring data and thinking with code
  • Tutorialspoint: Coding Platform For Your Website
  • Kaggle: Your Machine Learning and Data Science Community
  • Google Colab
  • OctaveOnline: Create and share scripts for scientific computing with GNU Octave
  • Project Jupyter
  • GeoGebra: Free online math tools for graphing, geometry, 3D.
  • Notepad++
  • VSCode / VSCode server
  • Gitpod

Maths Tools

Creative content

Video Editor

  • Adobe Premium, After effect
  • Sony Vegas
  • ACDSee
  • imovie
  • FFMpeg

Photo Editor

  • Photoshop
  • GIMP
  • INKSCAPE

3D Builder

  • Blender
  • Shapr3D: a professional CAD tool built for the mobility and precision of the iPad and Apple Pencil
  • SketchUp: 3D Design Software | 3D Modeling on the Web
  • SolidWorks
  • AutoDesk: AutoCAD
  • Tinkercad: easy-to-use 3D CAD design tool
  • Blender

Web Platform

Blog

Archive

Blockchain & new Tech

Networking and IoT

Online Data Storage

Other

No Code/ Low Code tech

  • NoCodeList: a place for all the no code web app
  • NoCodeStack: a place for all the no code web app
  • SideProjectStack: another place for all the no code web app
  • Airtable
  • Framer: A free prototyping tool for teams.
  • Bravo
  • Editor X
  • Webflow
  • anima
  • supernova
  • Lobe: No code Object recoginition
  • Miro

+++

Data science/AI/ML/framework

  • Tensorflow
  • Apache Spark: Batch programming
  • Apache Flink: Stateful Computations over Data Streams
  • OpenMP: multi-platform shared-memory parallel programming in C/C++ and Fortran
  • OpenACC: help the research and developer community advance science by expanding their accelerated and parallel computing skills
  • Chapel: programming language designed for productive parallel computing at scale
  • Apache Airflow
  • Kubeflow
  • ML Flow
  • Apache Cassendra
  • Spark Streaming
  • Apache Kafka: open-source stream-processing software platform
  • Akka: toolkit for building highly concurrent, distributed, and resilient message-driven applications for Java and Scala
  • Apache Storm: free and open source distributed realtime computation system
  • KubeEdge
  • HBase
  • Hadoop
  • BlazingSQL: BlazingSQL provides a high-performance distributed SQL engine in Python
  • Apache ORC: High-Performance Columnar Storage for Hadoop
  • Apache Parquet:a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language.
  • RAPIDS: Open GPU Data Science
  • XGBoost: optimized distributed gradient boosting library designed to be highly efficient, flexible and portable
  • Dask: Dask provides advanced parallelism for analytics, enabling performance at scale for the tools you love
  • Apache Hive: data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL
  • Apache Zeppelin: Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
  • Weka.io: Weka uses a modern storage architecture to solve today’s biggest data-intensive problems that hold back innovation.
  • Apache Samza: Samza allows you to build stateful applications that process data in real-time from multiple sources including Apache Kafka. Battle-tested at scale
  • Apache Impala: is a modern, open source, distributed SQL query engine for Apache Hadoop.
  • Apache Nifi: manage data in the edge. Apache NiFi supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic
  • Apache Drill: Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage
  • Apache Sqoop: tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.
  • Apache Oozie: Workflow Scheduler for Hadoop
  • Apache Mahout: Apache Mahout(TM) is a distributed linear algebra framework and mathematically expressive Scala DSL designed to let mathematicians, statisticians, and data scientists quickly implement their own algorithms.
  • Apache Flume: Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data
  • Apache Beam: Implement batch and streaming data processing jobs that run on any execution engine
  • Apache Zookeeper: Coordinates other services; Starts before other services
  • YARN: "Yet Another Resource Negotiator"; allows other applications to run on Hadoop
  • Apache Oozie: Schedules workflows, manages multiple jobs
  • Apache Pig: Transform and analyze large dataset with Pig Latin
  • Hangfire: An easy way to perform background processing in .NET and .NET Core applications.

Custom AI Docker

Stack

  • stack

Vendor/SaaS

  • Algolia: Site Search & Discovery powered by AI
  • Onfido: Document ID & Facial Biometrics Verification SaaS