BLOG | Jimeng Shi

Transformer Details

Introduce each detail of the Transformer Achitecture

Links for Transformer https://bbs.cvmart.net/articles/4032 https://www.zhihu.com/question/347678607 https://zhuanlan.zhihu.com/p/338592312 http://nlp.seas.harvard.edu/2018/04/03/attention...

Posted by Jimeng on August 2, 2021

Difference between epoch and iteration

Introduce the difference between epoch, iteration and batch size

Epoch One Epoch is when an ENTIRE dataset is passed forward and backward through the neural network only ONCE. Why we use more than one Epoch? I know it doesn’t make sense in the starting th...

Posted by Jimeng on May 22, 2021

Memory & Storage of Computer

Categories of different computer memories

Memory & Storage There are a lot of memories in the computer. They can be divided into 2 big categories: internal memeory and external memory. The big difference between them is to see if the...

Posted by Jimeng on April 23, 2021

Ubuntu Common Commands

Share some common commands and shortcuts of Ubuntu

1. Sudo $ sudo: SuperUser DO Sudo allows you to run programs or other commands with administrative privileges, just like “Run as administrator” in Windows. 2. Apt-Get Apt-get is used to install...

Posted by Jimeng on March 1, 2021

Ubuntu Remote Connection

How to use your local terminal to control Ubuntu?

1. Update the system using the apt command or apt-get command: $ sudo apt update $ sudo apt upgrade 2. Ubuntu Linux install OpenSSH server on Ubuntu Linux $ sudo apt install openssh-server 3. V...

Posted by Jimeng on January 6, 2021

Markdown Cheat Sheet

Summarize some useful and common syntax of Markdown edition

Title # Heading 1 ## Heading 2 ### Heading 3 Heading 1 Heading 2 Heading 3 Text Bold: **Bold text** Italic: *Italic text* Delete line: ~~Delete line~~ Bold text Italic text Delete line Link...

Posted by Jimeng on January 3, 2021

Git Instructions

Summarize some common git instructions

Based on my personal experience, sharing some common git instructions I used a lot! GitHub: Create New Repository git init git add README.md git commit -m "first commit" git remote add origin...

Posted by Jimeng on September 7, 2020

Introduction to Machine Learning

Definition and Classification of Machine Learning

1 What is Machine Learning? Arthur Samuel (1959): “Field of study that gives computers the ability to learn without being explicitly programmed. Tom Michel (1999): “A computer program is said to ...

Posted by Jimeng on January 1, 2020

Data Pre-processing Methods

Data cleaning, data integration, data transformation, data normalization

Chinese Version 1 Introduction In engineering practice, the data we get may contain a large number of missing values, repeated values, outliers, etc., and a large amount of noise. It may also be t...

Posted by Jimeng on December 8, 2019

Jimeng Shi