Articles

Squashing Commits

EN

In Git, you might accumulate multiple small commits over the course of developing a new feature, fixing small bugs, or refactoring code. While these incremental commits are crucial during active development, they can clutter the project history in the long term. This clutter becomes especially evide...

Regularization

EN

Regularization adds a preference among fitted models through a penalty or constraint. It can reduce sensitivity to training noise by accepting bias in exchange for lower variability. Its predictive value depends on the data, representation, and penalty strength, so it is assessed using validation da...

Clustering

EN

Clustering summarizes inputs by assigning observations to groups under a chosen notion of similarity. K-means represents each group by a centroid and minimizes squared Euclidean reconstruction distance. Its groups depend on feature scaling, the number of centroids, and initialization; they need a su...

Recommendation Systems

EN

Recommendation systems are a fundamental component in the interface between users and large-scale content providers like Amazon, eBay, and iTunes. These systems personalize user experiences by suggesting products, movies, or content based on past interactions and preferences...

Linear Regression Multiple Variables

EN

Multiple linear regression extends the concept of simple linear regression to multiple independent variables. This technique models a dependent variable as a linear combination of several independent variables...

Machine Learning System Design

EN

These notes outline the key strategies and considerations for developing a spam classification system. This process involves several steps, from feature selection to error analysis, and addresses the challenges of working with skewed datasets...

Review of Linear Algebra

EN

Linear Algebra forms the backbone of many machine learning algorithms, including linear regression. Understanding matrices and vectors is fundamental in this context...

Applying Machine Learning Advice

EN

When facing high error rates with a machine learning model, especially when tested on new data, various strategies can be employed to diagnose and address the problem...

Anomaly Detection

EN

Anomaly detection involves identifying data points that significantly differ from the majority of the data, often signaling unusual or suspicious activities. This technique is widely used across various domains, such as fraud detection, manufacturing, and system monitoring...

Introduction to Machine Learning

EN

Machine Learning (ML), a subset of artificial intelligence, is the scientific study of algorithms and statistical models that computer systems use to effectively perform a specific task without using explicit instructions. It relies on patterns and inference instead. ML algorithms build a mathematic...

Support Vector Machines

EN

Support vector machines fit a decision score using a margin-based loss and a coefficient norm penalty. Comparing hinge with logistic loss explains their objectives. The SVM construction also leads to kernels that can represent nonlinear boundaries...

Neural Networks Learning

EN

Learning minimizes an explicit loss over network parameters. Forward propagation calculates predictions; backpropagation applies the chain rule to calculate derivatives of that loss. An optimizer then uses those derivatives to update weights and biases. Keeping these operations separate makes their ...

Large Scale Machine Learning

EN

Training machine learning models on large datasets poses significant challenges due to the computational intensity involved. To effectively handle this, various techniques such as stochastic gradient descent and online learning are employed. Let's delve into these methods and understand how they fac...

Logistic Regression

EN

Logistic regression is a statistical method used for classification in machine learning. Unlike linear regression, which predicts continuous values, logistic regression models a conditional class probability. A separate decision rule turns that probability into a label, such as spam or non-spam...

Neural Networks Representation

EN

A neural network composes parameterized transformations of its input. A hidden layer can learn combinations of features, and a nonlinear activation prevents the entire network from collapsing into one linear map. The appropriate architecture depends on the task, sample size, and computational constr...

Linear Regression

EN

Linear Regression is a fundamental type of supervised learning algorithm in statistics and machine learning. It's utilized for modeling and analyzing the relationship between a dependent variable and one or more independent variables. The goal is to predict continuous output values based on the inpu...

Dimensionality Reduction

EN

Principal Component Analysis (PCA) is a widely used technique in machine learning for dimensionality reduction. It simplifies the complexity in high-dimensional data while retaining trends and patterns...

Photo Ocr

EN

Optical Character Recognition (OCR) enables computers to interpret text within images. This process involves a machine learning pipeline comprising several steps, each focused on a specific aspect of OCR, such as locating text, separating characters, and classifying their images. The pipeline integr...

Selinux

EN

SELinux stands for Security-Enhanced Linux...

Logical Volume Management

EN

Storage devices such as HDDs, SSDs, USB drives, and virtual disks provide raw space. Before that space can be used conveniently, it usually needs to be divided, organized, formatted, and mounted...

Encryption

EN

Encryption is one of the main tools used to protect digital information. It keeps data private by changing readable information into an unreadable form. The readable version is called plaintext, and the unreadable version is called ciphertext...

Task State Analysis

EN

Task-state analysis is a way to understand what processes and threads are doing by looking at their runtime states...

Shells and Bash Configuration

EN

A Unix shell is a command-line program that lets a user communicate with the operating system. Instead of using buttons and menus, the user types commands, and the shell interprets those commands...

Performance Monitoring

EN

Performance monitoring is the process of observing how a system uses its resources...

Managing Users

EN

In Linux, user management is a crucial aspect of system administration. A user is essentially an entity that can log into the computer system and perform tasks based on the permissions granted to them. The Linux operating system stores user-related information in a couple of key files: /etc/passwd a...

Kernel

EN

We will now delve deeply into the Linux kernel to understand its role in the operating system, where it resides on your system, and how kernel modules function. We will also explore how to download and examine the Linux kernel source code, and discuss the various configuration options available with...

Grep

EN

The grep command is one of the most powerful and versatile tools in the Unix and Unix-like operating systems, including Linux and macOS. Its name stands for global regular expression print, and it is primarily used for searching plain-text data sets for lines that match a regular expression or a fix...

Containers and Docker

EN

Containers have fundamentally changed the way software is built, shipped, and run. If you've spent time administering Linux systems, managing packages, configuring services, and troubleshooting dependency conflicts, you already understand the pain that containers were designed to solve. A container ...

Processes

EN

In any operating system, a process is the fundamental unit of execution—a live instance of a program. Beyond its executable code (the text segment), a process encompasses its dynamic state: the program counter, CPU registers, call stack, heap, and other variable storage. To manage and schedule these...

Log Files and Journals

EN

Understanding how logging works in Linux is like learning the language your system uses to communicate. Logs are the detailed records that your system keeps about its activities, and they are invaluable for troubleshooting, monitoring performance, and ensuring security. Let's embark on a journey to ...

Environment Variable

EN

In Unix-style shells, variables let you store and reuse pieces of information, such as your preferred editor...

Permissions

EN

File permissions are crucial in any Unix-like operating systems, including Linux, which employ several mechanisms for controlling access to files and directories. These mechanisms include standard permissions, special permissions, and access control lists (ACLs)...

Ldap

EN

LDAP stands for Lightweight Directory Access Protocol...

Sed and Awk

EN

sed (Stream Editor) and awk are powerful command-line utilities that originated from Unix and have become indispensable tools in Unix-like operating systems, including Linux and macOS. They are designed for processing and transforming text, allowing users to perform complex text manipulations with s...

Partitions

EN

Partitioning a disk involves dividing a physical storage device into separate, manageable sections called partitions. Each partition functions as an independent disk within the operating system, allowing for better organization, multi-boot setups, or separation of system files from user data. The tw...