25_특별한_형식의_텍스트_파일_처리.ipynb

{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"25_특별한_형식의_텍스트_파일_처리.ipynb","version":"0.3.2","provenance":[],"collapsed_sections":[]},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.6.5"},"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"}},"cells":[{"cell_type":"markdown","metadata":{"id":"bVvRlQt27rK5","colab_type":"text"},"source":["# 특별한 형식의 텍스트 파일: CSV, INI, YAML 파일과 파이썬 프로그램 파일"]},{"cell_type":"markdown","metadata":{"id":"sriMo-ek7rK9","colab_type":"text"},"source":["## CSV 파일\n","\n","표 형식의 테이터를 텍스트 파일로 저장할 때 사용하는 파일 형식이 CSV 파일이다.\n","CSV가 comma-separated values지만 빈칸이나 탭(tab)으로 값을 구분한 파일도 일반적으로 CSV 파일로 분류한다.\n","그러니까 CSV 파일은 일반적으로 delimiter-separated format(구분자로 분리하는 형식)로 생각할 수 있다.\n","CSV 파일의 MIME 타입은 \"text/csv\"이다."]},{"cell_type":"markdown","metadata":{"id":"-a9WbW_97rK-","colab_type":"text"},"source":["MIME(Multipurpose Internet Mail Extensions)는 전자우편을 위한 인터넷 표준 형식이다. 전자우편은 7비트 ASCII 문자를 사용하여 전송되기 때문에, unicode를 포함한 8비트 이상의 코드를 사용하는 문자나 이진 파일들은 MIME 형식으로 변환되어 전송된다. 실질적으로 전송되는 대부분의 전자우편은 MIME 형식이다. MIME 표준에 정의된 MIME 형식은 HTTP와 같은 통신 프로토콜에서 사용된다."]},{"cell_type":"markdown","metadata":{"id":"Tr_V5WVq7rLA","colab_type":"text"},"source":["### CSV 파일의 데이터 저장 형식\n","\n","1. 행(row)/레코드(record)는 줄바꿈 문자(newline character, enter eky, \\n)로 구분한다.\n","2. 행은 여러 값(value)으로 구성되며 구분자(delimiter)로 구분한다.\n","3. 모든 행에는 동일한 개수의 값을 동일한 순서로 기재한다.\n","4. 모든 값은 문자열이다.\n","5. 따라서 값을 큰 따옴표로 감쌀 수 있다. 구분자를 포함하는 값은 반드시 큰 따옴표로 감싸야 한다.\n","6. 값이 큰 따옴표를 포함할 경우에는 값에 포함된 큰 따옴표를 이중 큰 따옴표로 나타낸다.\n","7. 첫 번째 행에 열(column) 이름을 기재할 수 있다."]},{"cell_type":"markdown","metadata":{"id":"zwEm61Kl7rLD","colab_type":"text"},"source":["### CSV 파일의 읽기와 쓰기\n","\n","`csv` 모듈에 정의된 클래스를 이용하여 CSV 파일을 읽고 쓸 수 있지만 `pandas` 모듈의 `read_csv()`를 이용해서 `DataFrame` 객체로 만드는 것이 가장 좋은 방법이다."]},{"cell_type":"code","metadata":{"id":"gDGM2gNe7rLE","colab_type":"code","colab":{}},"source":["import pandas as pd\n","df = pd.read_csv(\n","    'https://raw.githubusercontent.com/joongyang/python-for-raw-beginners/master/datasets/sample.csv',\n","    sep=',',  # 값을 구분하는 구분문자를 지정한다.\n","    header='infer', # 열 이름이 기재된 행의 번호를 쓴다.\n","                    # 쓰지 않으면 자동 추출을 시도한다.\n","    names=None,     # 열 이름을 리스트로 지정한다.\n","    index_col=None, # 행 이름으로 사용할 값이 저장된 열 이름을 지정한다.\n","    skiprows=None,  # 파일 앞 부분에서 읽지 않고 건너뛸 줄의 수를 지정한다.\n","    skipfooter=0,   # 파일 뒷 부분에서 읽지 않고 건너뛸 줄의 수를 지정한다.\n","    nrows=None,     # 몇 행만 읽을 것인지를 지정한다.\n","    na_values=None) # 결측치를 나타내는 문자열을 리스트로 지정할 수 있다."],"execution_count":0,"outputs":[]},{"cell_type":"code","metadata":{"id":"ELgQrzVg7rLJ","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":203},"outputId":"21a62174-0529-466b-8a91-e5a7c41460f1","executionInfo":{"status":"ok","timestamp":1559610462673,"user_tz":-540,"elapsed":690,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["df.head()"],"execution_count":2,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>region</th>\n","      <th>sex</th>\n","      <th>nb_voters</th>\n","      <th>percent</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>서울</td>\n","      <td>남</td>\n","      <td>4065823</td>\n","      <td>9.58</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>서울</td>\n","      <td>여</td>\n","      <td>4301830</td>\n","      <td>10.14</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>부산</td>\n","      <td>남</td>\n","      <td>1438478</td>\n","      <td>3.39</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>부산</td>\n","      <td>여</td>\n","      <td>1509375</td>\n","      <td>3.56</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>대구</td>\n","      <td>남</td>\n","      <td>1002006</td>\n","      <td>2.36</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["  region sex  nb_voters  percent\n","0     서울   남    4065823     9.58\n","1     서울   여    4301830    10.14\n","2     부산   남    1438478     3.39\n","3     부산   여    1509375     3.56\n","4     대구   남    1002006     2.36"]},"metadata":{"tags":[]},"execution_count":2}]},{"cell_type":"markdown","metadata":{"id":"QDsbIXaU7rLB","colab_type":"text"},"source":["### 연습문제\n","\n","1. `https://raw.githubusercontent.com/joongyang/python-for-raw-beginners/master/datasets/sample.csv` 파일을 읽어서 DataFrame 객체를 만드시오."]},{"cell_type":"markdown","metadata":{"id":"-l69dT9G7rLT","colab_type":"text"},"source":["데이터를 `DataFrame` 객체로 만들면 CSV 파일로 쉽게 저장할 수 있다."]},{"cell_type":"code","metadata":{"id":"hPhk_SIt7rLV","colab_type":"code","colab":{}},"source":["df.to_csv(\"/content/gdrive/My Drive/practice/sample_backup.csv\",\n","          sep=',',      # 구분문자를 지정한다.\n","          na_rep='',    # 결측치를 나타낼 문자열 지정한다.\n","          columns=['region', 'sex', 'nb_voters'], # 파일에 출력할 열 이름을 지정한다.\n","                        #모든 열을 다 저장하려면 column 매개변수를 지정하지 않는다.\n","          header=True,  # 열 이름을 출력할 것인지를 지정한다.\n","          index=False   # 행 이름을 출력할 것인지를 지정한다.\n",")"],"execution_count":0,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"0QVP2c0F7rLf","colab_type":"text"},"source":["## INI 파일\n","\n","확장자가 `.ini`인 텍스트 파일을 INI 파일이라고 하며 주로 소프트웨어의 설정 파일로 사용된다."]},{"cell_type":"markdown","metadata":{"id":"GVsHsWcG7rLh","colab_type":"text"},"source":["### INI 파일의 데이터 저장 형식\n","\n","1. INI 파일에 저장하는 기본적인 항목을 키(key) 또는 속성(property)이라고 한다.\n","2. 속성은 이름(name)과 값(value)을 가진다.\n","3. 이름과 값은 =로 구분한다.\n","4. 등호의 왼쪽이 속성의 이름이고 오른쪽이 속성의 값이다.\n","5. 여러 속성을 집단으로 나눌 수 있으며 집단은 섹션(section)이라고 한다.\n","6. 섹션의 이름은 `[]` 감싸며 독립된 한 줄에 나타낸다.\n","7. 섹션 이름과 속성 이름은 case-insensitive하다.\n","8. ;로 시작하는 줄은 주석이다."]},{"cell_type":"markdown","metadata":{"id":"kUBN32OX7rLj","colab_type":"text"},"source":["### INI 파일의 읽기와 쓰기\n","\n","`configparser` 모듈에 정의된 `ConfigParser` 클래스를 이용해서 INI 파일을 읽을 수 있다.\n","\n","**Note:** INI 파일을 ANSI encoding으로 저장해야 할지도 모른다."]},{"cell_type":"code","metadata":{"id":"1AMU9vWjCvzh","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":971},"outputId":"41696d89-35c8-494b-c169-08add6c4639c","executionInfo":{"status":"ok","timestamp":1559610884273,"user_tz":-540,"elapsed":795,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["from urllib.request import urlopen\n","url = 'https://raw.githubusercontent.com/joongyang/python-for-raw-beginners/master/datasets/sample.ini'\n","\n","response = urlopen(url)\n","sample_ini = response.read()      # a `bytes` object\n","sample = sample_ini.decode('utf-8') # 때로는 utf-16을 시도해야 할 수도 있다.\n","print(sample)"],"execution_count":8,"outputs":[{"output_type":"stream","text":["[database]\r\n","ZBaseDbType   = ORG.oclc.db.DbRemoteZ\r\n","dbName        = everglades\r\n","remoteZDbName = Eol\r\n","Longname      = Everglades Online\r\n","FullText      = FALSE\r\n","#FullTextRecordSyntax = MARC\r\n","recordSyntax  = MARC\r\n","SupportsSort  = TRUE\r\n","supportsScan  = FALSE\r\n","IllService    = NONE\r\n","ServerName    = library\r\n","ServerIniFile = servers/library.ini\r\n","\r\n","\r\n","[Formats]\r\n","full            = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","duplicates      = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","multifull       = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","brief           = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","briefduplicates = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","fullnf          = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","multifullnf     = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","briefnf         = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","bookmark        = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","bookmarkfull    = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","bookmarkDups    = format/obiv1/MarcArticleFormatsLibrary.ini\r\n","# isoill          = format/obiv1/MarcArticleILLFormat.ini\r\n","# termlist        = format/obiv1/MarcRTLFormatLibrary.ini \r\n","dump            = ORG.oclc.fmts.obi.RecordDumper\r\n","\r\n","\r\n","  \r\n","# Settings for using the TermFinder capabilities  \r\n","# to retrieve a related term list for the database.  \r\n","  \r\n","# [TermFinder]  \r\n","# TermListSearchIndex     = Species\r\n","# SampleSize              = 20\r\n","# TermFinderSearchIndex   = CommonName  \r\n","# UseAdjacencyInTFSearch  = FALSE\r\n","\r\n","# this allows for more than 1 attribute type BIB1, EXP1, ZDSR\r\n","[attributes]\r\n","type*= BIB1attributes\r\n","\r\n","[BIB1attributes]\r\n","OID            = BIB1\r\n","default        = Keyword\r\n","browse_default = Keyword\r\n","operator       = 1\r\n","stopwords      = default \r\n","filter = ORG.oclc.qnorm.RemoteZTermNormalizer\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"VQO8FVQPDc_6","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"9687f6ad-01ee-4e87-a0b8-c897698ab90e","executionInfo":{"status":"ok","timestamp":1559610919727,"user_tz":-540,"elapsed":677,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["import os\n","os.getcwd()"],"execution_count":9,"outputs":[{"output_type":"execute_result","data":{"text/plain":["'/content'"]},"metadata":{"tags":[]},"execution_count":9}]},{"cell_type":"code","metadata":{"id":"RWQKvEgSDkuW","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"fcfdbbd1-120f-41f3-a1c9-37590dfcafd2","executionInfo":{"status":"ok","timestamp":1559610942146,"user_tz":-540,"elapsed":675,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["os.listdir()"],"execution_count":10,"outputs":[{"output_type":"execute_result","data":{"text/plain":["['.config', 'friends.txt', 'gdrive', 'sample_data']"]},"metadata":{"tags":[]},"execution_count":10}]},{"cell_type":"code","metadata":{"id":"5zChIsdKDrUu","colab_type":"code","colab":{}},"source":["fo = open('/content/sample_data/sample.ini', 'w')\n","fo.write(sample)\n","fo.close()"],"execution_count":0,"outputs":[]},{"cell_type":"code","metadata":{"id":"qcBU2JAT7rLk","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"08b83d3e-80ca-4421-fa19-33c8b16a1daa","executionInfo":{"status":"ok","timestamp":1559611064161,"user_tz":-540,"elapsed":645,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["from configparser import ConfigParser\n","config = ConfigParser()\n","config.read('/content/sample_data/sample.ini')"],"execution_count":12,"outputs":[{"output_type":"execute_result","data":{"text/plain":["['/content/sample_data/sample.ini']"]},"metadata":{"tags":[]},"execution_count":12}]},{"cell_type":"markdown","metadata":{"id":"yUApE_b87rLr","colab_type":"text"},"source":["섹션의 목록은 `sections()` 메소드로 구한다."]},{"cell_type":"code","metadata":{"id":"sbEP_Wv_7rLs","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"9563ac4b-71d1-4455-cc80-362d926dd2f4","executionInfo":{"status":"ok","timestamp":1559611072006,"user_tz":-540,"elapsed":621,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["config.sections()"],"execution_count":13,"outputs":[{"output_type":"execute_result","data":{"text/plain":["['database', 'Formats', 'attributes', 'BIB1attributes']"]},"metadata":{"tags":[]},"execution_count":13}]},{"cell_type":"markdown","metadata":{"id":"RSySb4Lk7rL4","colab_type":"text"},"source":["`options()` 메소드에 섹션 이름을 인자로 주면 특정한 섹션에 들어 있는 속성의 이름을 리스트로 구할 수 있다."]},{"cell_type":"code","metadata":{"id":"sn9potMu7rL7","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":215},"outputId":"0867cd95-f9b7-4448-feda-3b830330897b","executionInfo":{"status":"ok","timestamp":1559611081930,"user_tz":-540,"elapsed":648,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["config.options('database')"],"execution_count":14,"outputs":[{"output_type":"execute_result","data":{"text/plain":["['zbasedbtype',\n"," 'dbname',\n"," 'remotezdbname',\n"," 'longname',\n"," 'fulltext',\n"," 'recordsyntax',\n"," 'supportssort',\n"," 'supportsscan',\n"," 'illservice',\n"," 'servername',\n"," 'serverinifile']"]},"metadata":{"tags":[]},"execution_count":14}]},{"cell_type":"markdown","metadata":{"id":"4nWe6OHM7rMF","colab_type":"text"},"source":["특정 색션의 특정 속성의 값을 구할 때는 `get()` 메소드로 구한다.\n","섹션 이름과 속성 이름을 `get()` 메소드의 인자로 주면 된다."]},{"cell_type":"code","metadata":{"id":"2MNaM3Hv7rMH","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"77e67c8e-070e-4853-8390-bb2bf43e14e2","executionInfo":{"status":"ok","timestamp":1559611100683,"user_tz":-540,"elapsed":628,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["config.get('database', 'longname')"],"execution_count":15,"outputs":[{"output_type":"execute_result","data":{"text/plain":["'Everglades Online'"]},"metadata":{"tags":[]},"execution_count":15}]},{"cell_type":"markdown","metadata":{"id":"nKEr93C-7rMW","colab_type":"text"},"source":["다음은 INI 파일을 구성해서 저장하는 예제 코드이다.\n","모든 섹션은 사전 객체이며, 각 섹션에 속하는 속성의 이름과 값도 사전 객체로 처리된다."]},{"cell_type":"code","metadata":{"id":"pzczCGOI7rMY","colab_type":"code","colab":{}},"source":["conf = ConfigParser()\n","conf['DEFAULT'] = {'ServerAliveInterval': '45',\n","                      'Compression': 'yes',\n","                      'CompressionLevel': '9'}\n","conf['bitbucket.org'] = {}\n","conf['bitbucket.org']['User'] = 'hg'\n","conf['topsecret.server.com'] = {}\n","conf['topsecret.server.com']['Port'] = '50022'\n","conf['topsecret.server.com']['ForwardX11'] = 'no'\n","conf['DEFAULT']['ForwardX11'] = 'yes'\n","\n","fo = open('/content/sample_data/new_sample.ini', 'w')\n","conf.write(fo)\n","fo.close()"],"execution_count":0,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"jGUm9YBn7rMh","colab_type":"text"},"source":["## YAML 파일\n","\n","INI 파일과 같이 설정 파일로 사용되는 파일 형식으로 YAML 파일이 있다.\n","YAML은 YAML Ain't Markup Language의 약자이다.\n","YAML 파일의 확장자는 `.yml` 또는 `.yaml`이다."]},{"cell_type":"markdown","metadata":{"id":"DK5FhK917rMj","colab_type":"text"},"source":["### YAML 파일의 저장 형식\n","\n","1. 구조를 나타내기 위해 들여쓰기를 이용한다.\n","2. 들여쓰기 할 때 탭은 사용하지 않는다.\n","3. #은 주석의 시작을 나타낸다. 주석은 줄의 어디에서나 시작할 수 있으며 줄의 끝까지가 주석으로 처리된다.\n","4. 리스트의 원소는 쉼표로 구분하고 `[]`로 감싼다..\n","5. 리스트의 원소를 한 줄에 하나씩 나타낼 수 있다. 이때 각 줄은 -(hyphen)으로 시작한다.\n","6. 사전과 같은 연관 배열은 쉼표로 구분한 `키:값`을 `{}`로 감싼다.\n","7. 연관 배열의 모든 `키:값`을 `{}`로 감싸지 않고 한 줄에 `키:값` 하나 씩 기재할 수 있다. 이때 각 줄은 하이펀으로 시작한다.\n","7. 문자열은 큰 따옴표나 작은 따옴표로 감싼다.\n","8. 하나의 스트림에 여러 YAML 문서를 저장할 수 있다. 각 문서의 시작을 3개 이상의 하이펀으로 구분한다.\n","9. 각 문서의 끝은 3개의 마침표로 지정할 수 있다."]},{"cell_type":"markdown","metadata":{"id":"VTvNp8Ic7rMk","colab_type":"text"},"source":["### YAML 파일의 읽기와 쓰기\n","\n","YAML 파일을 지원하는 패키지는`PyYAML`이다.\n","사용법은 INI 파일과 거의 같다."]},{"cell_type":"code","metadata":{"id":"XYrOwNxi7rMr","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":1115},"outputId":"0386f1bb-daaa-44fa-8adc-6c08c9152eb0","executionInfo":{"status":"ok","timestamp":1559611371344,"user_tz":-540,"elapsed":763,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["url = 'https://raw.githubusercontent.com/joongyang/python-for-raw-beginners/master/datasets/sample.yml'\n","\n","response = urlopen(url)\n","sample_ini = response.read()      # a `bytes` object\n","sample = sample_ini.decode('utf-8')\n","\n","print(sample)\n","\n","fo = open('/content/sample_data/sample.yml', 'w')\n","fo.write(sample)\n","fo.close()\n"],"execution_count":19,"outputs":[{"output_type":"stream","text":["# =================================================================\r\n","# Cloud Information\r\n","# =================================================================\r\n","cloud:\r\n","  # Cloud Name: The cloud name must not contain spaces or special\r\n","  # characters. The name is used for the OpenStack region name.\r\n","  name: MyCloudName\r\n","  # Cloud Description\r\n","  description: Controller + N Compute Topology - x86 KVM\r\n","  # Cloud Administrator (admin) User's Password\r\n","  password: MyCloudPassword\r\n","  # Cloud Database Service Type: db2 or mysql\r\n","  database_service_type: db2\r\n","  # Cloud Messaging Service Type: rabbitmq or qpid\r\n","  messaging_service_type: rabbitmq\r\n","  # Cloud Features: The cloud features to be enabled or disabled.\r\n","  features:\r\n","    self_service_portal: enabled\r\n","    platform_resource_scheduler: enabled\r\n","  # Cloud Topology: References the node name(s) for each role\r\n","  # within the cloud's topology.\r\n","  topology:\r\n","    database_node_name: controller\r\n","    controller_node_name: controller\r\n","    self_service_portal_node_name: controller\r\n","    kvm_compute_node_names: kvm_compute\r\n","\r\n","# ================================================================\r\n","# Environment Information\r\n","# ================================================================\r\n","environment:\r\n","  base: example-ibm-os-single-controller-n-compute\r\n","  default_attributes:\r\n","  # (Optional) Add Default Environment Attributes\r\n","\r\n","  override_attributes:\r\n","  # (Optional) Add Override Environment Attributes\r\n","\r\n","\r\n","# ================================================================\r\n","# Node Information\r\n","# ================================================================\r\n","nodes:\r\n","  - name: controller\r\n","    description: Cloud controller node\r\n","    fqdn: controllername.company.com\r\n","    password: passw0rd\r\n","    identity_file: ~\r\n","    nics:\r\n","      management_network: eth0\r\n","      data_network: eth1\r\n","  - name: kvm_compute\r\n","    description: Cloud KVM compute node\r\n","    fqdn: kvmcomputename.company.com\r\n","    password: ~\r\n","    identity_file: /root/identity.pem\r\n","    nics:\r\n","      management_network: eth0\r\n","      data_network: eth1\r\n","    # (Optional) Node Attribute JSON File\r\n","    attribute_file: ~\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"JEisOR9EFATE","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":503},"outputId":"37c0a320-d5e8-4706-d3aa-b03b680f7569","executionInfo":{"status":"ok","timestamp":1559611423654,"user_tz":-540,"elapsed":680,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["import yaml\n","fi = open('/content/sample_data/sample.yml', 'r')\n","conf = yaml.load(fi)\n","fi.close()\n","conf"],"execution_count":20,"outputs":[{"output_type":"execute_result","data":{"text/plain":["{'cloud': {'database_service_type': 'db2',\n","  'description': 'Controller + N Compute Topology - x86 KVM',\n","  'features': {'platform_resource_scheduler': 'enabled',\n","   'self_service_portal': 'enabled'},\n","  'messaging_service_type': 'rabbitmq',\n","  'name': 'MyCloudName',\n","  'password': 'MyCloudPassword',\n","  'topology': {'controller_node_name': 'controller',\n","   'database_node_name': 'controller',\n","   'kvm_compute_node_names': 'kvm_compute',\n","   'self_service_portal_node_name': 'controller'}},\n"," 'environment': {'base': 'example-ibm-os-single-controller-n-compute',\n","  'default_attributes': None,\n","  'override_attributes': None},\n"," 'nodes': [{'description': 'Cloud controller node',\n","   'fqdn': 'controllername.company.com',\n","   'identity_file': None,\n","   'name': 'controller',\n","   'nics': {'data_network': 'eth1', 'management_network': 'eth0'},\n","   'password': 'passw0rd'},\n","  {'attribute_file': None,\n","   'description': 'Cloud KVM compute node',\n","   'fqdn': 'kvmcomputename.company.com',\n","   'identity_file': '/root/identity.pem',\n","   'name': 'kvm_compute',\n","   'nics': {'data_network': 'eth1', 'management_network': 'eth0'},\n","   'password': None}]}"]},"metadata":{"tags":[]},"execution_count":20}]},{"cell_type":"code","metadata":{"id":"VYU5sgQi7rMz","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":215},"outputId":"938a151e-1e7b-4dc4-f78c-c07ac48cfaba","executionInfo":{"status":"ok","timestamp":1559611431216,"user_tz":-540,"elapsed":615,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["conf['cloud']"],"execution_count":21,"outputs":[{"output_type":"execute_result","data":{"text/plain":["{'database_service_type': 'db2',\n"," 'description': 'Controller + N Compute Topology - x86 KVM',\n"," 'features': {'platform_resource_scheduler': 'enabled',\n","  'self_service_portal': 'enabled'},\n"," 'messaging_service_type': 'rabbitmq',\n"," 'name': 'MyCloudName',\n"," 'password': 'MyCloudPassword',\n"," 'topology': {'controller_node_name': 'controller',\n","  'database_node_name': 'controller',\n","  'kvm_compute_node_names': 'kvm_compute',\n","  'self_service_portal_node_name': 'controller'}}"]},"metadata":{"tags":[]},"execution_count":21}]},{"cell_type":"code","metadata":{"id":"jUQ0yFmL7rM5","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"d5bf7245-9188-44f4-9299-307f496d32a8","executionInfo":{"status":"ok","timestamp":1559611437553,"user_tz":-540,"elapsed":813,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["conf['cloud']['name']"],"execution_count":22,"outputs":[{"output_type":"execute_result","data":{"text/plain":["'MyCloudName'"]},"metadata":{"tags":[]},"execution_count":22}]},{"cell_type":"markdown","metadata":{"id":"AEQTwEpc7rNH","colab_type":"text"},"source":["YAML 파일의 모든 것은 사전으로 처리되므로 데이터를 사전으로 정리한 다음 YAML 파일로 저장할 수 있다."]},{"cell_type":"code","metadata":{"id":"7_ejUeDs7rNJ","colab_type":"code","colab":{}},"source":["conf = {'web_server': ['192.168.0.2', '192.168.0.3'], 'db_server': ['192.168.10.7'],\n","       'users':{'joongyang': '12345', 'park': 'abcde', 'gnu': 'abc123'}}\n","fo = open('/content/sample_data/new_sample.yml', 'w')\n","fo.write(yaml.dump(conf, default_flow_style=False))\n","fo.close()"],"execution_count":0,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"Z5tUrfaT7rNQ","colab_type":"text"},"source":["## JSON 파일\n","\n","JSON(JavaScript Object Notation)는 통신에서 데이터를 전달하는데 주로 사용하는 텍스트 형식이다."]},{"cell_type":"markdown","metadata":{"id":"x5NWYTM27rNR","colab_type":"text"},"source":["### JSON 파일의 저장 형식\n","\n","1. 숫자는 소숫점을 포함할 수 있으며 과학적 표기법으로 나타낼 수도 있다.\n","2. 문자열은 0개 이상의 유니코드 문자의 열이다.\n","3. 문자열은 큰 따옴표로 감싸며 이스케이프 시퀀스를 허용한다.\n","4. 논리값을 true와 false로 나타낸다.\n","5. 배열은 쉼표로 구분한 값을 `[]`로 감싼다.\n","6. 여러 개의 속성과 값을 가진 객체는 `{}`로 감싼다. 속성과 값은 `속성:값` 형식으로 기재하고 쉼표로 구분한다.\n","7. 결측치는 null로 표기한다."]},{"cell_type":"markdown","metadata":{"id":"i__VhQ-U7rNS","colab_type":"text"},"source":["### JSON 파일의 읽기와 쓰기\n","\n","`json` 패키지를 이용하면 JSON 파일을 읽고 쓸 수 있다\n"]},{"cell_type":"code","metadata":{"id":"WwBT2z1YGClG","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":721},"outputId":"8b55bee5-1441-43d4-80f2-8f8e6022bd37","executionInfo":{"status":"ok","timestamp":1559611690371,"user_tz":-540,"elapsed":707,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["url = 'https://raw.githubusercontent.com/joongyang/python-for-raw-beginners/master/datasets/sample.json'\n","\n","response = urlopen(url)\n","sample_json = response.read()      # a `bytes` object\n","sample = sample_json.decode('utf-8')\n","\n","print(sample)\n","\n","fo = open('/content/sample_data/sample.json', 'w')\n","fo.write(sample)\n","fo.close()\n"],"execution_count":25,"outputs":[{"output_type":"stream","text":["{\r\n","    \"name\":\"Topology1\",\r\n","    \"description\":\"This is a topology\",\r\n","    \"environment\":\"os-single-controller-n-compute\",\r\n","    \"secret_file\":\"data_bags/example_data_bag_secret\",\r\n","    \"run_sequentially\":false,\r\n","    \"concurrency\":10,\r\n","    \"nodes\": [\r\n","        {\r\n","            \"name\": \"controller\",\r\n","            \"description\": \"This is the controller node\",\r\n","            \"fqdn\":\"controllername.company.com\",\r\n","            \"password\":\"passw0rd\",\r\n","            \"run_order_number\":1,\r\n","            \"quit_on_error\":true,\r\n","            \"chef_client_options\": [\r\n","                \"-i 3600\",\r\n","                \"-s 600\"\r\n","            ],\r\n","            \"runlist\": [\r\n","                \"role[ibm-os-single-controller-node]\"\r\n","            ]\r\n","        },\r\n","        {\r\n","            \"name\": \"KVM qemu compute\",\r\n","            \"description\": \"This is a KVM qemu compute node\",\r\n","            \"fqdn\":\"computename.company.com\",\r\n","            \"user\":\"admin\",\r\n","            \"identity_file\":\"/root/identity.pem\",\r\n","            \"run_order_number\":2,\r\n","            \"allow_update\": false,\r\n","            \"runlist\": [\r\n","                \"role[ibm-os-compute-node-kvm]\"\r\n","            ],\r\n","            \"attributes\":\"{\\\"openstack\\\":{\\\"compute\\\":{\\\"libvirt\\\":{\\\"virt_type\\\":\\\"qemu\\\"}}}}\"\r\n","        }\r\n","    ]\r\n","}\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"qtIy-TCQ7rNT","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":431},"outputId":"757ae8bd-bd49-4aef-9bc8-72baa5836f76","executionInfo":{"status":"ok","timestamp":1559611718022,"user_tz":-540,"elapsed":640,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["import json\n","fi = open('/content/sample_data/sample.json', 'r')\n","js = json.load(fi)\n","fi.close()\n","js"],"execution_count":26,"outputs":[{"output_type":"execute_result","data":{"text/plain":["{'concurrency': 10,\n"," 'description': 'This is a topology',\n"," 'environment': 'os-single-controller-n-compute',\n"," 'name': 'Topology1',\n"," 'nodes': [{'chef_client_options': ['-i 3600', '-s 600'],\n","   'description': 'This is the controller node',\n","   'fqdn': 'controllername.company.com',\n","   'name': 'controller',\n","   'password': 'passw0rd',\n","   'quit_on_error': True,\n","   'run_order_number': 1,\n","   'runlist': ['role[ibm-os-single-controller-node]']},\n","  {'allow_update': False,\n","   'attributes': '{\"openstack\":{\"compute\":{\"libvirt\":{\"virt_type\":\"qemu\"}}}}',\n","   'description': 'This is a KVM qemu compute node',\n","   'fqdn': 'computename.company.com',\n","   'identity_file': '/root/identity.pem',\n","   'name': 'KVM qemu compute',\n","   'run_order_number': 2,\n","   'runlist': ['role[ibm-os-compute-node-kvm]'],\n","   'user': 'admin'}],\n"," 'run_sequentially': False,\n"," 'secret_file': 'data_bags/example_data_bag_secret'}"]},"metadata":{"tags":[]},"execution_count":26}]},{"cell_type":"code","metadata":{"id":"8wMmtscJ7rNY","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":55},"outputId":"082a78d3-5e40-4042-cf57-b1dd394a1ac9","executionInfo":{"status":"ok","timestamp":1559611725789,"user_tz":-540,"elapsed":841,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["js.keys()"],"execution_count":27,"outputs":[{"output_type":"execute_result","data":{"text/plain":["dict_keys(['name', 'description', 'environment', 'secret_file', 'run_sequentially', 'concurrency', 'nodes'])"]},"metadata":{"tags":[]},"execution_count":27}]},{"cell_type":"code","metadata":{"id":"jRYFhgxf7rNc","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":323},"outputId":"b316e490-8f13-4d2c-91df-cd876ec59936","executionInfo":{"status":"ok","timestamp":1559611728579,"user_tz":-540,"elapsed":609,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["js['nodes']"],"execution_count":28,"outputs":[{"output_type":"execute_result","data":{"text/plain":["[{'chef_client_options': ['-i 3600', '-s 600'],\n","  'description': 'This is the controller node',\n","  'fqdn': 'controllername.company.com',\n","  'name': 'controller',\n","  'password': 'passw0rd',\n","  'quit_on_error': True,\n","  'run_order_number': 1,\n","  'runlist': ['role[ibm-os-single-controller-node]']},\n"," {'allow_update': False,\n","  'attributes': '{\"openstack\":{\"compute\":{\"libvirt\":{\"virt_type\":\"qemu\"}}}}',\n","  'description': 'This is a KVM qemu compute node',\n","  'fqdn': 'computename.company.com',\n","  'identity_file': '/root/identity.pem',\n","  'name': 'KVM qemu compute',\n","  'run_order_number': 2,\n","  'runlist': ['role[ibm-os-compute-node-kvm]'],\n","  'user': 'admin'}]"]},"metadata":{"tags":[]},"execution_count":28}]},{"cell_type":"code","metadata":{"id":"vclEvDzB7rNk","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":179},"outputId":"6d7e57bd-bf86-420f-f054-a65cf4dc4b82","executionInfo":{"status":"ok","timestamp":1559611734607,"user_tz":-540,"elapsed":644,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["js['nodes'][1]"],"execution_count":29,"outputs":[{"output_type":"execute_result","data":{"text/plain":["{'allow_update': False,\n"," 'attributes': '{\"openstack\":{\"compute\":{\"libvirt\":{\"virt_type\":\"qemu\"}}}}',\n"," 'description': 'This is a KVM qemu compute node',\n"," 'fqdn': 'computename.company.com',\n"," 'identity_file': '/root/identity.pem',\n"," 'name': 'KVM qemu compute',\n"," 'run_order_number': 2,\n"," 'runlist': ['role[ibm-os-compute-node-kvm]'],\n"," 'user': 'admin'}"]},"metadata":{"tags":[]},"execution_count":29}]},{"cell_type":"code","metadata":{"id":"cbMaDA2E7rNq","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":55},"outputId":"940dc6a1-bc9b-45bf-fdf7-428e0aa36146","executionInfo":{"status":"ok","timestamp":1559611741994,"user_tz":-540,"elapsed":654,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["js['nodes'][1].keys()"],"execution_count":30,"outputs":[{"output_type":"execute_result","data":{"text/plain":["dict_keys(['name', 'description', 'fqdn', 'user', 'identity_file', 'run_order_number', 'allow_update', 'runlist', 'attributes'])"]},"metadata":{"tags":[]},"execution_count":30}]},{"cell_type":"code","metadata":{"id":"3hhW6aFs7rNz","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"47f47455-19fd-496e-9ce7-0ffea26e8eaf","executionInfo":{"status":"ok","timestamp":1559611745095,"user_tz":-540,"elapsed":638,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["js['nodes'][1]['user']"],"execution_count":31,"outputs":[{"output_type":"execute_result","data":{"text/plain":["'admin'"]},"metadata":{"tags":[]},"execution_count":31}]},{"cell_type":"markdown","metadata":{"id":"5yuFeMAA7rN_","colab_type":"text"},"source":["내용을 수정한 다음 JSON 파일로 저장해보자."]},{"cell_type":"code","metadata":{"id":"JQ7k8xQp7rOA","colab_type":"code","colab":{}},"source":["del js['name']\n","del js['description']\n","del js['environment']\n","del js['secret_file']\n","js['department'] = {'name': 'information statistics', 'year': '1988', 'nb_prof': '7'}"],"execution_count":0,"outputs":[]},{"cell_type":"code","metadata":{"id":"fBMbhtCS7rOE","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":413},"outputId":"0e69b943-852d-4589-ad61-d7af86712306","executionInfo":{"status":"ok","timestamp":1559611760443,"user_tz":-540,"elapsed":630,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["js"],"execution_count":33,"outputs":[{"output_type":"execute_result","data":{"text/plain":["{'concurrency': 10,\n"," 'department': {'name': 'information statistics',\n","  'nb_prof': '7',\n","  'year': '1988'},\n"," 'nodes': [{'chef_client_options': ['-i 3600', '-s 600'],\n","   'description': 'This is the controller node',\n","   'fqdn': 'controllername.company.com',\n","   'name': 'controller',\n","   'password': 'passw0rd',\n","   'quit_on_error': True,\n","   'run_order_number': 1,\n","   'runlist': ['role[ibm-os-single-controller-node]']},\n","  {'allow_update': False,\n","   'attributes': '{\"openstack\":{\"compute\":{\"libvirt\":{\"virt_type\":\"qemu\"}}}}',\n","   'description': 'This is a KVM qemu compute node',\n","   'fqdn': 'computename.company.com',\n","   'identity_file': '/root/identity.pem',\n","   'name': 'KVM qemu compute',\n","   'run_order_number': 2,\n","   'runlist': ['role[ibm-os-compute-node-kvm]'],\n","   'user': 'admin'}],\n"," 'run_sequentially': False}"]},"metadata":{"tags":[]},"execution_count":33}]},{"cell_type":"code","metadata":{"id":"t7GUrn_v7rOM","colab_type":"code","colab":{}},"source":["fo = open('/content/sample_data/new_sample.json', 'w')\n","json.dump(js, fo, indent=3)\n","fo.close()"],"execution_count":0,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"qf00ai9e7rOP","colab_type":"text"},"source":["## 파이썬 프로그램 읽고 실행하기"]},{"cell_type":"markdown","metadata":{"id":"ihoT6mGg7rOQ","colab_type":"text"},"source":["확장자가 `.py`인 파이썬 프로그램 파일(모듈이라고도 한다)도 텍스트 파일이다.\n","따라서 파이썬 프로그램이 저장된 파일에서 프로그램을 읽어 와서 실행할 수 있다."]},{"cell_type":"code","metadata":{"id":"z9ElhGstG_g6","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":125},"outputId":"6930d7f7-da35-484d-f8d0-978c2d877ec9","executionInfo":{"status":"ok","timestamp":1559611881566,"user_tz":-540,"elapsed":652,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["url = 'https://raw.githubusercontent.com/joongyang/python-for-raw-beginners/master/datasets/sample.py'\n","\n","response = urlopen(url)\n","sample_json = response.read()      # a `bytes` object\n","sample = sample_json.decode('utf-8')\n","\n","print(sample)\n","\n","fo = open('/content/sample_data/sample.py', 'w')\n","fo.write(sample)\n","fo.close()"],"execution_count":35,"outputs":[{"output_type":"stream","text":["def say_hello(name):\n","    print('Good morning, ' + name + '?')\n","\n","name = input('What is your name? ')\n","say_hello(name)\n","\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"ZRezTqqZ7rOR","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":125},"outputId":"0fbffabc-1bf7-4d7b-afa1-521d4a31408f","executionInfo":{"status":"ok","timestamp":1559611904600,"user_tz":-540,"elapsed":636,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["fi = open('/content/sample_data/sample.py', 'r')\n","prog = fi.read()\n","fi.close()\n","print(prog)"],"execution_count":36,"outputs":[{"output_type":"stream","text":["def say_hello(name):\n","    print('Good morning, ' + name + '?')\n","\n","name = input('What is your name? ')\n","say_hello(name)\n","\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"iwCKspDQ7rOV","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":53},"outputId":"4fcf8ab6-7ace-4311-a261-04f14feb898a","executionInfo":{"status":"ok","timestamp":1559611926031,"user_tz":-540,"elapsed":13141,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["exec(prog)"],"execution_count":37,"outputs":[{"output_type":"stream","text":["What is your name? joongyang\n","Good morning, joongyang?\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"ga6nJfhp7rOZ","colab_type":"text"},"source":["파이썬 프로그램이 저장된 문자열을 컴파일한 결과를 저장해두면 프로그램을 반복해서 실행할 때 더 좋은 성능을 얻을 수 있다."]},{"cell_type":"code","metadata":{"id":"CuqlxkGG7rOa","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":53},"outputId":"51c7490a-a72b-45f1-aa33-3436d2d0105a","executionInfo":{"status":"ok","timestamp":1559611947199,"user_tz":-540,"elapsed":10413,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["cprog = compile(prog, '<string>', 'exec')\n","exec(cprog)"],"execution_count":38,"outputs":[{"output_type":"stream","text":["What is your name? joongyang\n","Good morning, joongyang?\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"YHKFeXdD7rOf","colab_type":"text"},"source":["또는 다음과 같이 프로그램 파일을 바로 컴파일할 수도 있다."]},{"cell_type":"code","metadata":{"id":"uSIZHKZM7rOg","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":53},"outputId":"58dab813-b98f-425a-f1ac-e0ef707e3fbe","executionInfo":{"status":"ok","timestamp":1559611971035,"user_tz":-540,"elapsed":3677,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["cprog = compile(prog, '/content/sample_data/sample.py', 'exec')\n","exec(cprog)"],"execution_count":39,"outputs":[{"output_type":"stream","text":["What is your name? park\n","Good morning, park?\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"ApKV5Tk97rOr","colab_type":"text"},"source":["## 컴파일 코드의 저장과 실행"]},{"cell_type":"markdown","metadata":{"id":"CmgG0jrP7rOs","colab_type":"text"},"source":["컴파일한 결과를 이진 파일로 저장할 수 있다.\n","이때 확장자는 `.pyc`를 사용한다.\n","다음은 `py_compile` 모듈을 이용해서 `sample.py`를 컴파일한 결과를 `sample.pyc`에 저장하는 예이다."]},{"cell_type":"code","metadata":{"id":"zrjW5n1u7rOt","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":35},"outputId":"afa53f24-0d29-43c8-9382-269774abe098","executionInfo":{"status":"ok","timestamp":1559612026213,"user_tz":-540,"elapsed":651,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["import py_compile\n","py_compile.compile('/content/sample_data/sample.py', '/content/sample_data/sample.pyc')"],"execution_count":40,"outputs":[{"output_type":"execute_result","data":{"text/plain":["'/content/sample_data/sample.pyc'"]},"metadata":{"tags":[]},"execution_count":40}]},{"cell_type":"markdown","metadata":{"id":"EgowfRSf7rOx","colab_type":"text"},"source":["컴파일된 코드가 저장된 파일은 이진 파일로 읽어야 한다.\n","machine's native format, bite order, timestamp가 저장된 첫 12바이트를 건너 뛰고 나머지만 읽어들이면 된다."]},{"cell_type":"code","metadata":{"id":"f5BAG-fG7rO1","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":53},"outputId":"73c3c255-d85a-45fb-ff15-3d4de3bf436d","executionInfo":{"status":"ok","timestamp":1559612069091,"user_tz":-540,"elapsed":12909,"user":{"displayName":"JoongYang Park","photoUrl":"https://lh6.googleusercontent.com/-mr_GHrd1pX0/AAAAAAAAAAI/AAAAAAAACFA/v5d6xq-MBRM/s64/photo.jpg","userId":"06333572283827112098"}}},"source":["import marshal\n","\n","s = open('/content/sample_data/sample.pyc', 'rb')\n","s.seek(12)\n","code_obj = marshal.load(s)\n","exec(code_obj)"],"execution_count":41,"outputs":[{"output_type":"stream","text":["What is your name? charles darwin\n","Good morning, charles darwin?\n"],"name":"stdout"}]}]}