전체 글36 Feedforward Neural Network / Multilayer Perceptron / Backpropagation / MLP for NLP Tasks / ReLu 1. 다층 퍼셉트론(MultiLayer Perceptron, MLP) 앞서 단층 퍼셉트론의 형태에서 은닉층이 1개 이상 추가된 신경망을 다층 퍼셉트론(MLP)이라고 한다고 배웠습니다. 다층 퍼셉트론은 피드 포워드 신경망(Feed Forward Neural Network, FFNN)의 가장 기본적인 형태입니다. 피드 포워드 신경망은 입력층에서 출력층으로 오직 한 방향으로만 연산 방향이 정해져 있는 신경망을 말합니다. Feedforward Neural Network - MLP와 같이 입-> 출력층 방향으로 연산이 전개되는 신경망 - An extension to perceptron by foring series connection between layers of parallel perceptrons: inpu.. 2021. 10. 24. Evaluation Metrics/ NL Representation / Distributional Hypothesis / Vector Embedding / Word Embedding / Matrix Factorization / Word2Vec / Skip-Gram / CBOW / Negative Sampling Evaluation Metrics F1 is biased towards the lower of precision and recall: F1은 정밀도와 재현율이 낮은 쪽으로 편향됩니다. harmonic mean words] - Sparsity in the NLP training datasets: natural language has a very huge space. NLP 희소 행렬을 만들면 사이즈가 너무 커짐 ex) Average Wikipedia page size is 580 words and English has ~1M words, yet the actual possibilities is far more. - We.. 2021. 10. 24. Perceptron, SVM, Computing Margin, Logistic Regression Perceptron 퍼셉트론 - Invited by Frank Rosenblatt in 1969 - Simple and limited (a single layer model) - Basic concepts are similar for multi-layer and deep models so it is a good learning tool - Still used in current applications,, e.g. modems Perceptron Learning Algorithm This is an iterative algorithm: 1. We initialize weights with random values 2. We do several pass on the whole training dataset .. 2021. 10. 24. NLP preprocessing / BoW (Bag of Words) / TF-IDF / Statistical Learning / Generative models VS Discriminative models / Naive Bayes Classification / Linear classification Classification - Categorizing instances of data into "classes:, where class members share some notion of simiarity ex) having positive sentiment Tokenization : Splitting the text into units for precessing - Removing extra spaces: the quality is high - Removing stop words : article, propositions, etc. - Contraction are standardizes: won't -> will not - Removing unhelpful words, e.g., extenral URL.. 2021. 10. 23. NLP란 무엇인가 : What is NLP Applied NLP Applied : we work with real language dat What is a natural language? - A means of communication that has envolved naturally in humans through use and repetition without conscious plagnning, e.g., English, Korean, etc. - 사람들이 말을 하고 반복하면서 진화하는 커뮤니케이션 수단 What is not a natural language? - Programming language : python - Formal languages : first order logic Processing : How to program com.. 2021. 10. 23. [week1] PHP Request-Response 총점 7 1. When a browser connects to a web server to retrieve a document, what is the default TCP/IP port that is used? 80 2. When a browser connects to a web server to retrieve a document, what command is sent to the server? GET 3. Which of the HTTP headers does the browser look at to decide how to display the retrieved document? Content-type 4. What does the second "T" of HTTP s.. 2021. 8. 15. 이전 1 2 3 4 5 6 다음
