python.csv

Import python module;import math;python
Import specific function of a module;from math import ceil;python
Import a module with abbreviation;import numpy as np;python
When directly called - programm is running from here;if __name__ == '__main__':;python
Check which python version is installed;python --version;python
Use modules / functions from other folder;"import sys, os
sys.path.append(os.path.join('C:/', 'Users\path_to_module'))	# Create Path to module
import RapidTechTools as rtt        # Import Module RapidTechTools";python
Install virtualenv;pip install virtualenv;python
Global packages installed;pip list;python
Shows where the python-file is (Windows);where python;python
Shows where the python-file is (Linux);which python;python
Create new virtual environment env;python -m virtualenv env;python
Create new virtual environment env (for python3 eg. on MacOS);python3 -m venv env;python
Extracts all the modules / dependencies to a txt-file;pip freeze --local > requirements.txt;python
Go back to the global environment;deactivate;python
Create new virtual env with specific python-version;virtualenv -p C:\..path to..\Python37\python.exe py37_env;python
Activate new virtual env named py37_env;py37_env\Scripts\activate;python
Shows the used python version in the virtual env;python --version;python
Install all the packages from requirements.txt;pip install -r requirements.txt;python
Windows: Show all installed python-versions + paths;py -0p;python
Activate environment;"venv\Scripts\activate
    when activated: pip list    #  Now only shows the installed modules for the virtual environment
    pip install package         #  Only installs in the activated virtual environment";python
install virtual environment with specific python-version;"download and install the python-version - Important: remember the path to the python.exe
create a venv with: virtualenv envName -p path\to\new_python.exe";python
install module;pip install moduleXY;python
upgrade module;pip install moduleXY --upgrade;python
Install specific version;pip install -Iv pyinstaller==4.8;python
uninstall module XY;pip uninstall module XY;python
show installed modules in actual environment;pip list;python
output modules in requirements.txt;pip freeze > requirements.txt;python
install modules from requirements.txt;pip install -r requirements.txt;python
Installation;pip install pyinstaller;python
Install specific version;pip install -Iv pyinstaller==4.8;python
Generate the bundle in a subdirectory called dist.;pyinstaller prg.py;python
Generate only one file;pyinstaller --onefile prg.py;python
Generate only one file (to get for sure the pyinstaller from the actual env);python -m Pyinstaller --onefile prg.py;python
Collect data for specific python module;--collect-data moduleXY;python
add this when some modules are not found;--copy-metadata pandas_ta;python
When some modules are making problems - sometimes this helps;--hidden-import=pymssql;python
<frozen importlib._bootstrap> error when using yfinance;pyinstaller --onefile --collect-data frozendict stockma3.py;python
when there is a depreciating warning from matlib;--exclude-module matplotlib;python
Generate file with icon;--icon=app.ico;python
Generating under mac os sometimes only work with this params;--hidden-import=pkg_resources.py2_warn;python
Generating under mac os sometimes only work with this params;--hidden-import=cmath;python
Open this file to start the python-program;prg.exe;python
only working with import yfinance (not with import yfinance as yf);yfinance module;python
Problems with some added python modules (eg. pycountry);"https://groups.google.com/g/pyinstaller/c/OYhJdeZ9010/m/32g3-T8XBAAJ
Create hook-file hook-pycountry.py with content:
	from PyInstaller.utils.hooks import copy_metadata, collect_data_files
	datas = copy_metadata(""pycountry"") + collect_data_files(""pycountry"")
Compile Program with
	pyinstaller --onefile --exclude-module matplotlib --additional-hooks-dir=. TestPyCountry.py";python
Problems with path when executing from py and exe;config_name = 'creds.json'                                    # Define the config file name;python
Determine if application is a script file or frozen exe;"if getattr(sys, 'frozen', False):                             # Get path when starting as executable
    application_path = os.path.dirname(sys.executable)
elif __file__:                                                # Get path when running from IDE as py-file
    application_path = os.path.dirname(__file__)
config_path = os.path.join(application_path, config_name)     # Final Config Path";python
Using Inno Setup Compiler for creating a setup.exe for all files;"https://jrsoftware.org/isdl.php
- Application Information => provide application informations (appName, appVersion, publisher, website)
- Application Files => select application main executable file and add all necessary folder and files
- Application File Association => no selection
- Application Documentation => select files which should be shown before / after the installation
- Setup Languages => select which languages should be included during installation
- Save installation script
- Final setup.exe is stored in the ""Output""-folder";python
"Comment / Uncomment selected lines (""/"" on numblock) (commenting in VS Code)";Ctrl K Ctrl C;python
"Comment / Uncomment selected lines (""/"" on numblock) (commenting in VS Code)";Ctrl K Ctrl U;python
Find in File;Ctrl F;python
Replace in File;Ctrl H;python
Selects whole line;Ctrl L;python
Search in all files;Ctrl Shift F;python
Replace in Path (in all Files);Ctrl Shift H;python
Jump to this Grouping Window;Ctrl 1/2/3;python
Find next;F3;python
Goto line;Ctrl G;python
Copy / Duplicate lines;Shift Alt Up/Down;python
Expand / Shrink selection;Shift Alt Left/Rigth;python
Move line;Alt Up/Down;python
Suggestions for fix error, function informations;Alt Enter;python
Open the project windows (on the left side);Alt 1;python
Show usage of the variable, function, class;Alt F7;python
Focus back on the editor window;Esc;python
Collapse everything;Ctrl K Ctrl 0;python
Expands everything;Ctrl K Ctrl J;python
"Collapse block (""-"" on numblock)";Ctrl K Ctrl L;python
"Expand block (""+"" on numblock)";Ctrl K Ctrl L;python
Select whole file;Ctrl A;python
Undo (backwards) / Redo (forwards);Ctrl (Shift) Z;python
Select word to the beginning;Ctrl Shift Left;python
Select word to the end;Ctrl Shift Right;python
Go one word left;Ctrl Left / Right;python
Delete current line;Ctrl Shift K;python
Delete to end of word;Ctrl Del;python
Delete to beginning of word;Ctrl Background;python
Hide/Show sidebar;Ctrl B;python
Hide/Show terminal;Ctrl J;python
Show command line (eg. open a file where the name is known);Ctrl P;python
Open the the command panel;Ctrl Shift P;python
Toggle through the open files in the editor;Ctrl TAB;python
Close File;Ctrl WARNING;python
MultiCursor - Select more cursors in rows for multiple change in rows;Ctrl Alt Up/Down;python
MultiCursor - Select Cursor at multiple positions for the same name;Ctrl D;python
Select all occurences of this word in the document and change all with one change;Ctrl Shift L;python
Select whole word;Ctrl D;python
Jump to the function definition;Ctrl Click;python
Close Tab;Ctrl W;python
Show suggestions for the actual code function / method;Ctrl Space;python
https://www.shortcutfoo.com/app/dojos/intellij-idea-win/cheatsheet;"Ctrl / 				      # Comment / Uncomment selected lines (""/"" on numblock) (commenting in VS Code)
Ctrl / 				      # Comment / Uncomment selected lines (""/"" on numblock) (commenting in VS Code)
Ctrl Alt F7 	      # Find usages
Ctrl F    		      # Find in File
Ctrl R         	    # Replace in File
Ctrl Shift R 		    # Replace in Path (in all Files)
F2            	    # jump to the next error
F3        			    # Find next
Ctrl G      		    # Goto line
Ctrl D 			        # Copy / Duplicate lines
Ctrl X              # Cut line (when nothing selected)
Ctrl C              # Copy line (when nothing selected)
Alt Shift Down/Up 	# Move line
Ctrl E       		    # Recent opened files
Ctrl TAB            # Switch windows in IDE
Ctrl (Shift) W      # Select / deselect parts of the code step by step
Alt Enter			      # Suggestions for fix error, function informations
Alt 1				        # Open the project windows (on the left side)
Alt F7				      # Show usage of the variable, function, class
Esc					        # Focus back on the editor window
Ctrl Shift -    	  # Collapse everything
Ctrl Shift +        # Exapnds everything
Ctrl - 				      # Collapse block (""-"" on numblock)
Ctrl + 				      # Expand block (""+"" on numblock)
Ctrl A         		  # Select whole file
Ctrl (Shift) Z 		  # Undo (backwards) / Redo (forwards)
Ctrl Shift Left 	  # Select word to the beginning
Ctrl Shift Right 	  # Select word to the end
Ctrl Left / Right 	# Go one word left
Ctrl Y              # Delete current line
Ctrl Del            # Delete to end of word
Ctrl Backspace      # Delete to beginning of word
lorem + TAB         # Create lorem text for html-code
p>lorem + TAB       # Create lorem text inside <p>-tags";python
https://www.makeuseof.com/tag/google-chrome-shortcuts-pdf/;"F5                  # Refresh site
Ctrl Tab            # Go tab right
Ctrl Shift Tab      # Go tab left
Ctrl F5             # Clear Cache and reload page";python
https://fossbytes.com/windows-keyboard-shortcuts-cheat-sheet-for-windows-10/;"Alt Tab         # Focus on other window
Ctrl C          # Copy
Ctrl X          # Cut
Ctrl VALUES     # Paste";python
Enable pushing with ssh-key in Idea and VSCode;"Enable open ssh agent: https://dev.to/aka_anoop/how-to-enable-openssh-agent-to-access-your-github-repositories-on-windows-powershell-1ab8
Run commands: https://stackoverflow.com/questions/56490194/vs-code-bitbucket-ssh-permission-denied-publickey";python
Import module for math calculations;import math;python
Import module for reading arguments from the command line;import sys;python
Using some numpy functions;import statistics as stat;python
Result without Decimals (=> 2);5 // 2;python
Modulo / Rest of the division (=> 1);7 % 2;python
Assigment of several varaibles;d,e,f = 4,5,6;python
Change / swap 2 values;a,b = b,a;python
Increase value by one;a += 1;python
"For better readability - ""_"" are possible using long num-values (will be ignored)";i = 1_000_000;python
Value is rounded to two decimal places => 77.23;round (77.2321, 2);python
Round to tens place;int(v - v%10);python
Conversion to String / Float / Int;"str(5), float(""5""), int(""5"")";python
Outputs absolute value => 2;abs(-2);python
Wait for pressing ENTER (or a keyboard stroke) to follow along;"input(""ENTER to continue"")";python
Input age and change to int;"int(input(""Alter?""))";python
Returns the type of a variable;type(var);python
Shows all available methods and attributes for the object as list;dir(var);python
Check if x has type format float (others: str,int,list,tuple,range,dict,set,bool);isinstance(x,float);python
Set var to max-value (float infinite);"x = float(""inf"")";python
Calculates the sqrt of the value => i3;math.sqrt(9);python
Check if a variable exists;"if ""myVar"" in locals():";python
Check for argument which is given when starting the program;sys.argv[1:].upper();python
"Print ""Text"" (with a linebreak \n at the end)";"print(""Text"")";python
Print with end-statement (next print will be in the same line;"print(""Text"", end=""-"")";python
Print text with linebreaks \n etc;"print(repr(""xyz\n""))";python
python test.py arg1 arg2 arg3;example starting program;python
Show the arguments from the command line when starting the program eg. ['test.py', 'arg1', 'arg2', 'arg3'];str(sys.argv);python
Len of the arguments - eg. 4 (program test.py itself and 3 arguments following);len(sys.argv);python
Find the minimum value => 3;min(3,5,7);python
Find the maximum value => 7;max(3,5,7);python
Find the mean value => 5 (with statistic-module - input must be given as list);stat.mean([3,5,7]);python
Stop program at this point (helpful in test-situations);exit();python
Calculate the change from an old value to a new value in percent;(newVal-oldVal)/oldVal * 100;python
Import pretty print functionality;import pprint as pp;python
pretty print dict line by line;pp.pprint(dict);python
pretty print with max line-length 30;pp.pprint(dict, width=30);python
pretty print only level 1 of nested list eg. ['level1', [...]];pp.pprint(nestedList,depth=1);python
pretty print only level 2 of nested list eg. ['level1', ['level2', [...]]];pp.pprint(nestedList,depth=2);python
convert binary value to decimal;"int(""1010"",2)";python
Import random module - fast, but not very secure;import random;python
Random int number between 1 and 6 like a cube;random.randint(1,6);python
Random float number between 1 and 3;random.uniform(1,3);python
Random value between 0 and 1 in float format - eg. 0.16394553;random.random();python
Random float in the range from 1 to 10;random.uniform(1,10);python
Random value for standard deviation;random.normal(0,1);python
Choose random entry from a list;random.choice(list);python
Choose 3 random (unique) entries from the list;random.sample(list,3);python
Choose 3 random entries from the list (possible to be the same);random.choices(list,k=3);python
Shuffle the content of a list;random.shuffle(l);python
Can reproduce the same results (unsecure);random.seed(1);python
generate a random uppercase 6-char string;""""".join(random.choices(string.ascii_uppercase, k=6))";python
Import secrets module - for security reasons (is slower);import secrets;python
Random int in the range from 0-10 (10 excluded);secrets.randbelow(10);python
Random int with 4 bits (highest possible value is 15 - 1111);secrets.randbits(4);python
Random choice (which is not reproducable);secrets.choice(l);python
Define string over more lines in editor with;"s = '''this \
	and this'''";python
first char of a string;c = s[0];python
last char of a string;c = s[-1];python
Insert variable in string oldest method (%s for string, %i for int, %f for float, %.2f for 2 decimals);"s = ""text %s bla"" % var";python
Insert variable in string old method (:.2f for 2 decimals);"s = ""text {} bla"".format(var)";python
Insert variable in string new method;"s = f""text {var} bla""";python
Format int with allways 2 digits;"s = f""{var:02d}""";python
Format float with allways 2 decimal places;"s = f""{float:0.2f}";python
Format float with 2 decmial places and overall 9 chars with leading 0;"s = f""{float:09.2f}";python
Multiple use;"""{0} like, {0} especially {0} but {1}"".format(""Joe"", ""noodles"")";python
Returns the index where the text is found;"s.find (""ist"")";python
Counts the occurrence of a text;"s.count (""i"")";python
Counts several chars in a text;re.findall('[.,’]', s);python
"Return all index of the char ""/"" in the string";"[i for i, c in enumerate(s) if c == ""/""]";python
Returns all index as a list (needs import re);[x.start() for x in re.finditer('ist', s)];python
Lowercase the whole string;s = s.lower();python
Capitalize the whole string;s = s.upper();python
Capitalize the first char;s = s.capitalize();python
Capitalize the first char of all words;s = s.title();python
"Check if string is starting with char ""H""";"s.startswith(""H"")";python
Check if string starts with several chars;"s.startswith((""H"",""F"",""L""))";python
"Check if string is ending with char ""H""";"s.endswith(""H"")";python
Check if string ends with several chars;"s.endwith((""H"",""F"",""L""))";python
"Split the words in a list which are seperated by "" """;"s.split("" "")";python
"Split for several chars (eg. "" "" and ""\n"" and "" ,"")";"re.split("" |\n| ,"", s)";python
"', 1)[0]								              => Split till the first occurence of ""=>""";s.split(';python
Split sentences after line breaks;s.splitlines();python
Delete all whitespaces at the beginning and the end;s = s.strip();python
Remove all duplicate spaces in a string;"s = "" "".join(s.split())";python
Replacement of two strings;"s = s.replace(""e"",""X"")";python
Replace several chars in a string;"s = re.sub(""[e0fi]"", ""X"", s)";python
Replace several chars in a string (get back a tupple: 1st changed string, 2nd: count of changed chars);"s = re.subn(""[e0fi]"", ""X"", s)";python
True if the whole string are digits;s.isdigit();python
True if the whole string are no digits;s.isalpha();python
TRUE if string2 is in strings1;s2 in s;python
Change string to list with all single chars;l = list(s);python
Convert char to ASCII value;ord(char);python
Convert ASCII value to char (eg. 65=A, 97=a);chr(ascii);python
Outputs hashvalue oif the string (needs import hashlib);hashlib.md5(s).encode('utf-8')).hexdigest();python
Execute statement in a string => hello;"exec(print(""hello""))";python
Gives the value of an expression => 4 (dangerous - can used for sql-injections);"eval(""2+2"")";python
Reverse a string;my_string[::-1];python
Print string with special characters;repr(s);python
check if any string is in another string or all strings are in another string;"s = ""A string is more than its parts!""
l = [""more"", ""blabla"", ""nothing""]
if any(x in s for x in l):                    # check if any elems from checks in string s
if not any(x in s for x in l):                # check if any elems from checks are NOT in string s
if all(x in s for x in l):                    # check if all elems from checks are in string s";python
import regex module;import re;python
Information about regex handling;https://medium.com/factory-mind/regex-tutorial-a-simple-cheatsheet-by-examples-649dc1c3f285;python
test regex strings;https://regex101.com/;python
"Find str with 4xdigits + ""-""char + 2xdigits";"pattern = re.compile(""^[0-9]{4}-[0-9]{2}$"")";python
Check if pattern matches - <> None when matches;pattern.match(s);python
"Find str with 4xdigits + ""-""char + 2xdigits";"pattern2 = re.compile(""[0-9]{4}-[0-9]{2}"")";python
"Find str with 3 to 4 xdigits + ""-""char + 2xdigits";"pattern2 = re.compile(""[0-9]{3,4}-[0-9]{2}"")";python
Check with fullmatch (^ and $ not necessary) - <> None when matches;pattern.fullmatch(s);python
"Char ""."" has to cherck with ""\n"" (is a wildcard letter in regex)";"pattern3 = re.compile (""[0-9]{1}\.[0-9]{3}"")";python
Replace all digits in string with blank;"re.sub(""\d"","""",s)";python
"Insert blank before every capitalized word eg. ""CostOfRevenue"" => ""Cost Of Revenue""";"re.sub(r'([a-z](?=[A-Z])|[A-Z](?=[A-Z][a-z]))', r'\1 ', ""txt"")";python
count all words which start and ends with a char from cL;"len(re.findall(f'[{cL}""]{w}[{cL}""]', l))";python
count all words which start with w and ends with a char from cL;"len(re.findall(f'^{w}[{charList}""]', l))";python
count all words which start with a char from cL and ends w;"len(re.findall(f'[{charList}""]{w}$', l))";python
count all words which have w in the middle of anything else;len(re.findall(f'(.*?){w}(.*?)', l));python
"Define pattern => as many digits (endless) + "" "" + one lowercase cahr + "":"" + as many digits (endless)";"pattern = ""([0-9]+) ([a-z]:([a-z]+)""";python
"Check if elem fits the pattern => returns <re.Match object; span=(0, 19), match=""3 n: nnnlncrnnnnn"">";match = re.search(pattern, elem);python
Assign the value of the first group => 3;value = match.group(1);python
"Show the full string => ""3 n: nnnlncrnnnnn""";all = match.group(0);python
Define several empty lists (NOT use l1=l=l3=[] => this would be the SAME list);l1,l2,l3,l4 = ([] for i in range(4));python
check for True if list has an element;if l;python
check for False if list is empty (same would be if l == [];if not l;python
Define list with content;l = [4,5,6];python
Define list - content is list from 0 to 19;l = list(range(20));python
Define list with 8 empyt strings;"l = ["""" for x in range(8)]";python
Uppercase the whole list;l = [x.upper(for x in l)];python
Define a nested list with 5x5;"l = [["""" for x in range(5)] for x in range(5)]";python
Add both lists together (to a new list);l1 + l2;python
Add 1 element to the list at the back;l.append(1);python
Add several elements to the list at the back;l.extend([6,5,4]);python
Insert an element at the index-position 3;"l.insert(3, ""xyz"")";python
"Returns first index position of element ""xyz""";"l.index(""xzy"")";python
Delete last element from list;l.pop();python
Delete first element from list;l.pop(0);python
Sort list ascending;l.sort();python
Sort list descending;l.sort(reverse=True);python
Sort list and store it in a different independent list;l_sort = sorted(l);python
Sort list descending and store it in a different independent list;l_sort = sorted(l, reverse=True);python
Sort the same way as the operating system (need: from natsort import os_sorted);l_sort = os_sorted(l);python
Check if a list is sorted (by ascending);if sorted(l) == l;python
Check if a list is sorted by descending;if sorted(l, reverse=True) == l;python
Sort list by len of elements;l.sort(key=len);python
Define nested list;l = [[1,4,3], [2,2,4], [3,1,5]];python
Sort nested list for the 2nd element ascending;l.sort(key=lambda x: x[1]);python
Sort nested list for the 2nd element descending;l.sort(key=lambda x: x[1], reverse=True);python
Sort nested list 1st for the 1st elem, then for the 2nd elem;l.sort(key=lambda x: (x[0], x[1]));python
Sort nested list 1st for the 1st elem, then for the 2nd elem descending;l.sort(key=lambda x: (x[0], x[1]), reverse=True);python
Reverse the complete list;l.reverse();python
Reverse complete list and store it in different independent list;l_reverse = list(reversed(l));python
Delete element at index position 2;del l[2];python
Delete first element with this value from the list;"l.remove(""abc"")";python
Delete complete content of the list (same as l = []);l.clear();python
Find smallest element in the list;min(l);python
Find greatest element in the list;max(l);python
Find longest string in the list;max(mylist, key=len);python
Find lenght of longest string in the list;len(max(mylist, key=len));python
Sum of all elements in the list;sum(l);python
Pair Sorting from 2 lists (1 with 1, 2 with 2, 3 mit 3, aso.);2xls_sum  = [sum(pair) for pair in zip(l1, l2)];python
Count of elements in list;len(l);python
"Count of occurence of the element ""a"" in the list";"l.count(""a"")";python
No seperate copy of the list (updates in both lists);l2 = l1;python
Separate individual copy of the list (no updates in both lists);l2 = l.copy();python
Separate individual copy of the list - 2nd variant;l2 = l[:];python
Separate individual copy of the list - 3rd variant;l2 = list(l);python
Seperate copying a nested list - import copy necessary;l2 = copy.deepcopy(l);python
First element;l[0];python
Last element;l[-1];python
Last 3 elements;l[-3:];python
Elements from index position 2 to 3;l[2:4];python
Elements from 0 to 1 (exclusive index position 2);l[:2];python
Elements from index position 2 to the end of the list;l[2:];python
Every second element [start:end:step];l[::2];python
Check if element is in list;9 in l;python
Check if any elements from the list are in the string;"if any(x in st for x in [""ab"",""cd"",""de""]):";python
Check if all elements from the list are in the string;"if all(x in st for x in [""ab"",""cd"",""de""]):";python
Check if all elements from the list are NOT in the string;"if all(x not in str for x in [""ab"",""cd""]):";python
Iterate through list content;for i in l:;python
Iterate through list with index;for i in range(len(l)):;python
Iterate through list with index and content;for idx, cont in enumerate(l):;python
Iterate through 2 lists pair-wise (stops when the shorter list is reached);for x,y in zip(l1,l2):;python
"Create string with elements joined together with "", "" eg. [""a"",""b"",""c""] => a, b, c";', '.join(l);python
Define list;a = [1,2,3,4,5];python
List is mapped with the lambda function => [2,4,6,8,10];list(map(lambda x: x*2, [1,2,3,4,5]));python
Also possible with list comprehension => [2,4,6,8,10];l=[x*2 for x in l];python
Also possible with list comprehension => [2,4];l=[x for x in l if x%2==0];python
List comprehension with if and else;l=[x*2 if x.isdigit() else x for x in l];python
List is filtered with lambda for even numbers => [2,4];list(filter(lambda x: x%2==0, [1,2,3,4,5]));python
Build paris as tuple => (1,4),(2,5),(3,6);zip([1,2,3],[4,5,6]);python
Remove duplicates from a list;list(set(l));python
Remove duplicates from a list and keep existing order;list(dict.fromkeys(l));python
Change elements in list to int;list(map(int,l));python
Transpose nested list (change rows and columns);[[x[i] for x in l] for i in range(len(l[0]))];python
rotate list for n places;"def rotate(l, n):
    return l[-n:] + l[:-n]";python
Iterate over 2 lists at the same time using zip;"animal = ['Cat', 'Dog', 'Fish', 'Goat']
age = [1, 2, 2, 6]
z = zip(animal, age)
for animal, age in z: ...";python
Adjust nested list to the same length;"maxLen = max(map(len, l))
for row in l:
  while len(row) < maxLen:
    row.append(None)";python
Create a tuple;t = (4,5,6);python
Create a tuple from a list;t = tuple([3,4,4];python
Selection / slicing of elements - same as with lists;t[];python
Change tuple to list;l = list(t);python
Change list to tuples;t = tuple(l);python
Assigning vars to tuple-elements (a=0, b=1, c=2);a,b,c = (0,1,2);python
Assigning to tuple-values (f=0, m=[1,2,3], l=4);f,*m,l = (0,1,2,3,4);python
Define empty dict;d = {};python
Define dict with content;"d = {""one"": 1, ""two"": 2, ""three"": 3}";python
2nd way to defince a dict with content;d = dict(one=1,two=2,three=3);python
Define dict with content (with dupels);"d = dict([(""one"",1),(""two"",2),(""three"",3)])";python
Define dict with content (with pairs in nested list);"d = dict([[""one"",1],[""two"",2],[""three"",3]])";python
Define dict with 2 different lists (1x keys and 1x values);"d = dict(zip([""one"",""two"",""three""], [1,2,3]))";python
Access value with key element (error when the key is not in the dict);"d[""two""]";python
BETTER: Acesss value with get for key element (no error when the key is not in the dict - returns second parameter instead);"d.get(""two"",""N/A"")";python
Access value - same as get - but also initialize the key when it is not in the dict - with the second parameter);"d.setdefault(""two"",""N/A"")";python
Find key for specific value (v) in dict;key = list(d.keys())[list(d.values()).index(v)];python
Read keys from dict to list;list(d.keys());python
Read values from dict to list;list(d.values());python
Count of entries in dict;len(d);python
Check if key is in dict (true / false);"""three"" in d";python
"New entry for dict (key = ""four"", value = 4)";"d[""four""] = 4";python
Delete specific key in dict;"del d[""one""]";python
Rename dict-keyname;mydict[new_key] = mydict.pop(old_key);python
Combine 2 dicts (if key is in both dicts - the second value will be taken);combined_dict = {**d1, **d2};python
Check if key is in dict;"if ""xyz"" in d:";python
Copying a dict (all changes will be made in BOTH dicts);d2 = d;python
Copying a dict (NOT WORKING with nested lists in the dict - use deepcopy!);d2 = d.copy();python
Copying a dict (NOT WORKING with nested lists in the dict - use deepcopy!);d2 = dict(d);python
Copying a dict (dicts will be handled seperate) - import copy necessary;d2 = copy.deepcopy(d);python
Dict d get updated with d2 (all existing keys are overwritten - and new added);d.update(d2);python
Iterate through dict keys;for key in d.keys():;python
Iterate through sorted dict keys ascending;for key in sorted(d.keys()):;python
Iterate through sorted dict keys descending;for key in sorted(d.keys(),reverse=True):;python
Iterate through dict values;for val in d.values():;python
Iterate through keys and values of the dict;for key, val in d.items():;python
built dict with dict-comprehension;d = {x[0]: x[1:] for x in l};python
Sort dict descending according to values (=item[1]);d = {k: v for k, v in sorted(d.items(), key=lambda item: item[1], reverse=True)};python
Sort dict ascending according to keys (=item[0]);d = {k: v for k, v in sorted(d.items(), key=lambda item: item[0])};python
Dict sorted: 1st value-desc (x[0]) - 2nd key-ascnd (-x[0]);d = {k: v for k, v in sorted(d.items(), key=lambda x: (-x[1],x[0]))};python
Sort dict and output list, sorted according to the 3rd element of the list in the dict;l = sorted(d.items(), key=lambda e: e[1][2]);python
Sort dict and output list, sorted according to the 3rd element of the list in the dict - descending;l = sorted(d.items(), key=lambda e: e[1][2], reverse=True);python
Merge 2 dictionaries;d3 = {key: d1.get(key,0)+d2.get(key,0) for key in set(d1)|set(d2)};python
save dict to pkl-file;"import pickle
with open(""fn.pkl"", ""wb"") as f:
  pickle.dump(dict, f)";python
read dict from pkl-file;"import pickle
with open('fn.pkl', 'rb') as f:
  d = pickle.load(f)";python
Define empty set - {} would define a dict and not a set;s=set();python
Define set with content;s = {1,1,2,2,3,4};python
"Define empty set - returns: {""o"",""l"",""H"",""e""}";"s = set(""Hello"")";python
Define second set;s2 = {1,7,8};python
Add element in set1;s.add(5);python
Add several elements to set1;s.update([10,11,12]);python
Intersection of 2 sets (same as: s.intersection(s2));s & s2;python
Untion of 2 sets (same as: s.union(s2));s | s2;python
Difference of 2 sets (same as: s.difference(s2));s - s2;python
True if s is subset from s2 (same as: s.issubset(s2));s <= s2;python
Check if element is in set;3 in s;python
Clear the set;s.clear();python
Delete lowest elmeent in set;s.pop();python
Delete element 5 from set - but key error possible;s.remove(5);python
Delete element 5 from set - NO key error possible;s.discard(5);python
Iterate through set content;for i in s:;python
Copying a set (all changes will be made in BOTH sets);s2 = s1;python
Copying a set (set will be handled seperate);s2 = s.copy();python
Copying a set 2nd method (set will be handled seperate);s2 = set(s);python
Define a frozenset - no changes are possible in the set - union, intersection aso. will work;s = frozenset(1,2,3);python
If / elif / else;"if x > 10: pass
elif x > 10: pass
else: pass";python
Use 2 conditions in one line (instead of (a>10 and a<20);if (10 < a < 20)...;python
Connecting different control structures with logical and &;if a<10 & b>10 & c==4...;python
5 iterations from 0 to 4;for i in range(5):;python
5 iterations from 0 to 4 (start, end, step);for i in range(0, 5, 1);python
Iterations descending from 4 to 0;for i in range(4, -1, -1);python
While loop with break condition;while x < 4:;python
Endless while loop - has to be exited with break;while True:;python
Break loop completely;break;python
Break actual loop run - continue with next loop run;continue;python
description of the function in form of a docstring;"def printNumAbbr(value):
'''
eg. Make abbreviaton for numeric value in thousands (K), millions (M), billions (B) or trillions (T)
:param value: numeric value which should be abbreviated
:return: string value with maximum possible abbreviation
'''";python
Define function - with default value 0 if no input is given;"def add(x=0,y=0):
    erg = x+y                   	# Calculation in function
    return erg                  	# Return value from the function";python
Optional argument in the funtction (first element is must - second optional);"def pet (animal,n1=None,n2=""x"")
pet(""Cat"")                      	# Calling function with n1=None and n2 = ""x""
pet(""Cat"",""name"")					# Calling function with n1=name and n2 = ""X""
pet(""Cat"",n2=""xyz"") 				# Calling function with n1=None and n2 = ""xyz"" (third parameter has to be named when calling)";python
Function with infinite arguments;"def varargs(*args): print(args)
varargs(1,2,3)                  	# Outputs (1,2,3)

def keyword_args(**kwargs):
    print(kwargs)
keyword_args(""a""=3, ""b""=4)      	# Outputs {""a"":3, ""b"":4}";python
decorator template;"def my_decorator(func):				# Define decorator
  @functools.wraps(func)
  def wrapper(*args,**kwargs):		# Decorator with * arguments
	  #Do...					 	# Do something before the functions
	  result=func(*args,**kwargs)	# Run the function
	  #Do...					 	# Do something after the functions
	  return result					# Return the results from the function
  return wrapper";python
decorator;"extend behaviour of a function with a decorators
def start_end_decorator(func):		# Define the decorator with function ""func"" as input-parameter
	def wrapper():					# Inside the decorator a wrapper function has to be defined
		print(""Start"")				# Decorated code which is executed before the core code from the function
		func()						# Calling the function itself
		print(""End"")				# Decorated code which is executed after the core code from the function
	return wrapper					# Results from the decorator have to be given back
@start_end_decorator				# Defines this decorator for the following function ""print_name""
def print_name():					# Normal content of the function
	print(""xyz"")					# Core functionality of the function
print_name()						# Now when the function is executed - outputs not only ""xyz"" - also ""Start"" before and ""End"" after";python
decorator with function arguments;"def start_end_decorator(func):		# Define the decorator with function ""func"" as input-parameter
	def wrapper(*args,**kwargs):	# Inside the decorator a wrapper function has to be defined
		print(""Start"")				# Decorated code which is executed before the core code from the function
		result = (*args,**kwargs)	# Calling the function itself
		print(""End "")				# Decorated code which is executed after the core code from the function
		return result
	return wrapper					# Results from the decorator have to be given back
@start_end_decorator				# Defines this decorator for the following function ""add5""
def add5(x):						# Normal content of the function with one argument
	return x + 5					# Core functionality of the function
result = add5(10)					# Outputs ""Start"" => ""End"" => 15
print(result)";python
Defines the generator with 3 yield statements;"def mygenerator():
	yield 3
	yield 2
	yield 1";python
Creates the generator and stores in g (=generator type);g = mygenerator();python
Outputs 3,2,1;for i in g: print(i);python
Outputs 3;print(next(g));python
Outputs 2;print(next(g));python
Sum-Function can also use a generator => result is 6;sum(g);python
Sorted-Function can use generator => returns list with sorted elements [1,2,3];sorted(g);python
try / except;"try:
	a = 5 / 0
except Exception as e:
	print(""Exception: "",e)						# Prints exception ""division by zero""";python
assert / raise;"x = -5
assert (x>=0), ""x is not positive""				# Checks / Assert some condition => prints ""x is not positive""
if x<0: raise Exception(""x should positive"")	# Raises an exception => prints ""Exception: x should be positive""";python
functions with one argument - add10(5) => 15;add10 = lambda x: x+10;python
functions with two arguments for multiplying - mult(2,7) => 14;mult = lambda x,y: x*y;python
output is sorted with first element then second element => [(1,2),(5,-1),(10,4),(15,1)];sorted(p);python
output is sorted by the second element => [(5,-1),(15,1),(1,2),(10,4)];sorted(p,key=lambda x:x[1]);python
output is sorted by the sum of both => [(1,2),(5,-1),(10,4),(15,1)];sorted(p,key=lambda x:x[0]+x[1]);python
list is mapped with the lambda function => [2,4,6,8,10];list(map(lambda x: x*2,a));python
also possible with list comprehension => [2,4,6,8,10];c=[x*2 for x in a];python
list is filtered with lambda for even numbers => [2,4];list(filter(lambda x: x%2==0,a));python
also possible with list comprehension => [2,4];c=[x for x in a if x%2==0];python
Define a class;"class Human(object):
  species = ""Homo Sapiens""    # Fix variable / class variable for all instances of the class
  def __init__(self,name):    # Constructor - automatically applied when an instance is created
      self.name = name		  # Name is assigned to the instance of the classe (self.)
	  self.tresor = []		  # Tresor is assigned as list to the instance of the class (self.)
  def say(self, msg):         # Methode of the class
      return ""{name}: {message}"".format(name=self.name, message=msg)
	  elf.tresor.append(msg)  # Tesor of the instance gets a new value in the list
  @classmethod                # Class methode - is used by all instances
  def get_species(cls):
      return cls.species
  @staticmethod               # Static methode - is called without class or method
  def grunt():
      return ""*grunt*""";python
Create instance of the class;"i = Human(name=""Ian"")";python
"Call the methode of the class (output: ""Ian: Hi"")";"print(i.say(""Hi""))";python
Create additonal instance of the class;"j = Human(name=""Joel"")";python
"Call the methode of the class (output: ""Joel: Hallo"")";"print(i.say(""Hallo""))";python
"Output ""Homo Sapiens""";i.get_species();python
"Same output  ""Homo Sapiens""";j.get_species();python
Change of the class variable - applies for all instances;"Human.species = ""Was Neues""";python
"Aufruf der statischen Methode => Ausgabe: ""*grunt*""";Human.grunt();python
Dataclasses;"from dataclasses import dataclass		# import dataclass necessary
@dataclass								# define a dataclass
class Coordinate:						# class is defined an need NO __init__, __repr__, __eq__
    x: int								# __init__ no necessary - values get assigned automatically
    y: int = 10							# __repr__ print for the string-represantion is automatic => Coordinate(x=4, y=5)
a = Coordinate(4, 5)
@dataclass (frozen=True)				# defines a unmutable instance
asdict(dc)								# converts the dataclass to a dict
astuple(dc)								# converts the dataclass to a tuple";python
Read textfile - and print it;"with open (""fn.txt"",""r"") as f: print(f.read()";python
Open File for Read and Write;"with open (""fn.txt"",""r+"") as f: print(f.read()";python
Read textfile - stored in list per line;"with open(fn, encoding=""utf8"", errors=""ignore"") as f:
  lines = f.readlines()";python
Writing in textfile;"with open(""fn.txt"",""w"") as obj: obj.write(""Ein neuer Text"")";python
Append text in the next line;"with open(""fn.txt"",""a"") as obj: obj.write(""\nNoch ein Text"")";python
Check if file allready exists;if os.path.exists(fn) == False:;python
Create and initialize file when not exisiting;"with open (fn,""a"") as f: f.write(""init"")";python
Read content to string;f.read();python
Set the current postion in the file to beginning;f.seek(0);python
Write s to the f-file opened;f.write(s);python
Try/Except - checks if file can be saved;"while True:
try:                         							# otherwise outputs a error message
  writer.save ()
  break
except Exception as e:
  print(f""Error happened: {e}"")
	traceback.print_exc()                               # Outputs the detailed error message
    input (""File Open not possible - pls close and press <Enter>"")";python
Import json-module;import json;python
Assign JSON-filename;"fn = ""numbers.json""";python
Reading informations in json-format;with open(fn) as data: info = json.loads(data);python
Convert / Encode a dict to a json-file (with indent for better reading);json_format = json.dumps(d,indent=2);python
Convert / Encode a dict to a json-file (with sorting the keys);json_format = json.dumps(d,sort_keys=True);python
Convert / Decode a json-file to a dict;person = json.loads(json_format);python
Reading information in json-format;"with open(fn.json,""r"") as data: d=json.load(file)";python
Pretty-Print formatted json-file;print(json.dumps(erg, indent=4, sort_keys=True));python
when there are utf-8 errors pls try to set the system variables;"import sys
sys.stdin.reconfigure(encoding='utf-8')
sys.stdout.reconfigure(encoding='utf-8')";python
ignoring errors and handles multiple json-objects;"with open(fnJSON, errors=""ignore"") as f:
  data = [json.loads(line) for line in f]";python
ignoring errors and handles multiple json-objects;"r = requests.get(tmpJSONWord)
jsonStrList = r.text.split(""\n"")
jsonList = [json.loads(j, errors=""ignore"") for j in jsonStrList if j != '']";python
write JSON to txt-file;"with open('dataDetail.json', 'w', encoding='utf-8') as f:
  json.dump(ergDetail, f, ensure_ascii=False, indent=4)";python
Example for json-file;"{
	""firstName"" : ""Chuck"",
	""lastName"" : ""Doe"",
	""hobbies"": [""running"",""swimming"",""singing""],
	""age"": 28,
	""hasChildren"": true
	""children"" = [
		{
			""firstName"" : ""Alex""
			""age"" : 5
		},
		{
			""firstName"" : ""Bob""
			""age"" : 7
		}
	]
}";python
"Read name value => ""Chuck""";"info[""firstName""]";python
Iterate trough the json-file (eg. many children);for item in children:;python
Import xml-module;import xml.etree.ElementTree as ET;python
Example for xml-file;"<persons>
	<person>
		<name>Chuck</name>
		<phone type=""int1""> +1 734 555""</phone>
		<email hide=""yes""/>
	</person>
	...
</persons>";python
Read xml-file into tree;tree = ET.fromstring(data);python
"Read name text => ""Chuck""";"tree.find(""name"").text";python
Read hide value from email => yes;"tree.find(""email"".get(""hide""))";python
Iterate trough xml-file (eg. many persons);"lst = persons.findall(""persons/person"")
for item in lst:";python
Import Module for URL parsing;import urllib.parse;python
Import Module for request;import urllib.request;python
Encode url;link = urllib.parse.quote_plus(link);python
Uncode url;link = urllib.parse.unquote_plus(link);python
Parse HTML-link1;"u = urlparse(""http://google.com/search"")";python
"Returns ""http""";u.scheme;python
"Returns ""/search""";u.path;python
"Returns ""google.com""";u.netloc;python
Download picture from a url;"opener = urllib.request.URLopener()
  opener.addheader('User-Agent', ""Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.106 Safari/537.36"")
  filename, headers = opener.retrieve(url, 'Test.jpg')";python
Download xlsx/csv from a url;"from urllib.request import urlopen, urlretrieve
  urlretrieve(hrefLink, filename)";python
Read csv-file to nested-list;"fn = os.path.join(path, ""inp.csv"")
with open(fn, ""r"", encoding=""utf-8"") as f:
  csvRead = csv.reader(f, delimiter="";"")
  inpData = [x for x in csvRead]

# when this error happens: _csv.Error: line contains NULL
with open(workFN, ""r"", encoding=""utf-16"") as f:
  ...

# when this error happens: UnicodeDecodeError: 'utf-8' codec can't decode byte 0x96
with open(workFN, ""r"", encoding=""mac_roman"") as f:
  ...";python
Create an empty csv-file;"with open(fnName, ""w"") as f:
    pass";python
Write csv-file from nested list;"FN = os.path.join(path, ""output.csv"")
with open(FN, 'w', newline='', encoding=""utf-8"") as f:
  writer = csv.writer(f, delimiter="";"")
  writer.writerows(l)";python
Read csv-file to a dictionary for every line;"with open (""products.csv"", ""r"", encoding=""utf-8"") as f:
  dictReader = csv.DictReader(f)
  for item in dictReader:
    for k,v in item.items():
      print(k,v)";python
Read csv-data from a HTML-link;"import urllib.request
import codecs
url = link                                                      # direct link to a csv html file
ftpstream = urllib.request.urlopen(url)
csvfile = csv.reader(codecs.iterdecode(ftpstream, 'utf-8'))     # output is nested list";python
Import zip module;import zipfile;python
Read Zip-File;zf = zipfile.ZipFile('example.zip', 'r');python
List of string with the names of the files in the Zip-File;zf.namelist();python
Open file vom Zip-File (eg. CSV-File which is in the Zip-File);zf.open (file_name);python
https://techwithtim.net/tutorials/google-sheets-python-api-tutorial/;"# Create a project on https://console.cloud.google.com/
# select name + click create + select project
# 3 lines upper/left - API/Services - Library
# search for google drive API + enable it
# search for google sheets api + enable it
# 3 lines upper/left - API/Services - Credentials
# create credentials for Service Accounts + define name + press Continue
# choose role ""editor"" + press Continue + press Done
# press on created service account + press keys + Add Key + Create New Key
# select json + and store json-file with name creds.json
# copy client_email entry from the json-file
# in google sheets - got to share in the document
# paste the email from above + press send";python
https://jrizmal.medium.com/deploying-a-python-web-scraper-on-google-cloud-platform-12fe24e57bb0;"# select project  (in titlebar right from Google Cloud Platform)
# create a function (search for cloud functions)
# set trigger (Cloud Pub/Sub) and create/select topic
# files needed for hosting: main.py (inside def hello_pubsub), requirements.txt, creds.json
# create schedule (search for cloud scheduler)";python
See further setup in tutorial;"import gspread                                                      # import module
import oauth2client                                                 # import module
from oauth2client.service_account import ServiceAccountCredentials  # import module for account credentials
from pprint import pprint                                           # import module for better output formatting
scope = [""https://spreadsheets.google.com/feeds"",
         'https://www.googleapis.com/auth/spreadsheets',
         ""https://www.googleapis.com/auth/drive.file"",
         ""https://www.googleapis.com/auth/drive""]
creds = ServiceAccountCredentials.from_json_keyfile_name
    (""creds.json"", scope)";python
Credentials Mgmt for GoogleSheets;gc = gspread.authorize(creds);python
Open the Google Sheet;"wb1 = gc.open(""NameOfSheet)";python
Open the first worksheet in the Google Sheet;ws1 = wb1.get_worksheet(0);python
Get all worksheets as worksheet-objects;listWS = wb1.worksheets();python
Get all worksheets by n;listWS = [x.title for x in wb1.worksheets()];python
Open the spreadhseet;"sheet = client.open(""testpython"").sheet1";python
Get a list of all records;dataList = ws1.get_all_values();python
Get specific area;data = ws1.get('B5:K8');python
Get formula of a cell;ws1.acell('B1', value_render_option='FORMULA').value;python
Update cell range with nested list;ws1.update('A1:Z10', [[1, 2], [3, 4]]);python
Insert new row at row number 2;"ws1.insert_row([""new1"",""new2"",""new3""],2)";python
Append new row at the end;"ws1.append_row([""new1"",""new2"",""new3""])";python
Sorting the sheet (Range + col1 asc + col2 desc);ws1.sort((1, 'asc'), (2, 'des'), range='A2:G20');python
Get row 3 (starts counting from 1 - not 0);row = sheet.row_values(3);python
Get col E (starts counting from 1 - not 0);col = sheet.col_values(5);python
Get values from col B rows 4 and 5;col = sheet.col_values(2)[3:5];python
Get the value from row 1 and col B;cell = sheet.cell(1,2).value;python
Update cell from row 2 and col B;"ws1.update_cell(2,2, ""CHANGED"")";python
Define cell area / cell row;cell_list = worksheet.range('A1:G1');python
Define new values for area / row;new_values = [1,2,3,4,5];python
https://pypi.org/project/gspread-formatting/;"# Set format for area:
	from gspread_formatting import *
	fmt = cellFormat(
		backgroundColor=color(1, 0.9, 0.9),
		textFormat=textFormat(bold=True, foregroundColor=color(1, 0, 1)),
		horizontalAlignment='CENTER'
		)
	format_cell_range(worksheet, 'A1:J1', fmt)
# Conditional formatting
	from gspread_formatting import *
	worksheet = some_spreadsheet.worksheet('My Worksheet')
	rule = ConditionalFormatRule(
		ranges=[GridRange.from_a1_range('A1:A2000', worksheet)],
		booleanRule=BooleanRule(
			condition=BooleanCondition('NUMBER_GREATER', ['100']),
			format=CellFormat(textFormat=textFormat(bold=True), backgroundColor=Color(1,0,0))
		)
	)
	rules = get_conditional_format_rules(worksheet)
	rules.append(rule)
	rules.save()

	# or, to replace any existing rules with just your single rule:
	rules.clear()
	rules.append(rule)
	rules.save()";python
https://openpyxl.readthedocs.io/en/stable/api/openpyxl.worksheet.worksheet.html#openpyxl.worksheet.worksheet.Worksheet.PAPERSIZE_A3;Documentation:;python
Read xlsx;"wb = ox.load_workbook(""test.xlsx"")";python
Read worksheetnames to list;l = wb.sheetnames;python
Select specific worksheet in workbook;"ws = wb[""sheet1""]";python
Select first worksheet;ws = wb[wb.sheetnames[0]];python
Select active worksheet from workbook;ws = wb.active;python
Value from specific cell;"val = ws[""A1""].value";python
Import module for loading a workbook;from openpyxl import load_workbook;python
Import module for creating a workbook;from openpyxl import Workbook;python
Load xlsx;"wb = load_workbook((""Test.xlsx""))";python
Load xlsm;"wb = load_workbook(filename=""Test.xlsm"",";python
Create new workbook;wb = openpyxl.Workbook();python
Create new worksheet (at the end);"wb.create_sheet(""ws"")";python
Create new worksheet (at the beginning);"wb.create_sheet(""ws"",0)";python
Create new worksheet (at the second last position);"wb.create_sheet(""ws"",-2)";python
Change worksheet name;"ws.title = ""xyz""";python
Value from specific cell (other method);ws.cell(row=1, column=1).value;python
Assign value to specific cell;"ws[""A1""] = 97";python
"Assign formula to specific cell (only english names for function and arguments must be sepearted by "","" and not "";"")";"ws[""A1""] = ""=SUBTOTAL(1,I6:I10000)""";python
Save workbook to xlsx;"wb.save(""Test2.xlsx"")";python
Sort worksheets in workbook;wb._sheets.sort(key=lambda ws: ws.title);python
Copy worksheet in workbook;wb.copy_worksheet(ws);python
Copy part of the worksheet;ws1.range('A1:Z20').copy(wb2.sheets[0].range('A1:Z20'));python
Loop trough specific area and print the cell values;"for row in ws[""A1"":""C3""]:
    for cell in row: print(cell.value)";python
Loop trough specific column and print the cell values;"for cell in ws[""C""]: print(cell.value)";python
Insert column before col 3;ws.insert_cols(3);python
Insert 2 columns before col 3;ws.insert_cols(3,2);python
Insert row before row 7;ws.insert_rows(7);python
Insert 5 rows before row 10;ws.insert_rows(10,5);python
Delete column C;ws.delete_cols(3);python
Delete column F to H;ws.delete_cols(6,3);python
Delete row 5;ws.delete_rows(5);python
Delete row 5 to 7;ws.delete_rows(5,3);python
Move the cells from D4:F10 up one row and right two columns;"ws.move_range(""D4:F10"", rows=-1, cols=2)";python
Append the values at the bottom of the sheet;"ws.append([1,""A"",2,""C""])";python
"Returns dimension of the worksheet eg. ""A1:M24""";ws.dimensions;python
Returns max column / row count of the worksheet;ws.max_column / ws.max_row;python
Returns min column / row count of the worksheet (which contains data);ws.min_column / ws.min_row;python
Rows 1:3 to be printed at the top of every page;ws.print_title_rows(1:3);python
Delete worksheet in workbook;"del wb[""sheet4""]";python
Define filters in columns A5 to Q5;"ws.auto_filter.ref = ""A5:Q5""";python
"Set filter to values ""X"",""Y"",""Z"" in column 2";"ws.auto_filter.add_filter_column(2,[""X"",""Y"",""Z""])";python
Sort elements in filter for columsn B2 to B15;"ws.auto_filter.add_sort_condition(""B2:B15"")";python
Close workbook;wb.close();python
Iterate trough worksheet row by row;"for row in ws.iter_rows():
    for cell in row: print(cell.value)";python
Iterate trough worksheet row by row (from A1 to C6 - 6 lines);"for row in ws.iter_rows
	(min_row=1,min_col=1,max_row=6,max_col=3):";python
Iterate trough worksheet col by col;"for col in sheet.iter_cols():
    for cell in col: print(cell.value)";python
Iterate trough worksheet col by col (from A1 to C6 - 3 lines);"for col in ws.iter_cols
	(min_row=1,min_col=1,max_row=6,max_col=3):";python
Read whole worksheet to a nested list;"data_list = []
for row in ws.iter_rows ():
    zeile = []
    for cell in row:
        if cell.value is None:
            zeile.append ('')
        else:
            zeile.append (cell.value)
    data_list.append (zeile)";python
Saving a nested list in XLSX;"import pandas as pd
from openpyxl import load_workbook
cont = [[row1_cell1, row1_cell2], [row2.cell1,row3_cell3]]      # Nested list for saving
book = load_workbook (""fn.xlsx"")                                # load existing XLSX - skip when overwriting
writer = pd.ExcelWriter (""fn.xlsx"", engine='openpyxl',          # Define writer from pandas
                         options={'strings_to_numbers': True})
pd.DataFrame (cont).to_excel (writer, sheet_name=""WS1"",			# Prepare Data for XLSX and worksheet1
                              header=False, index=False)
pd.DataFrame (cont).to_excel (writer, sheet_name=""WS2"",			# Prepare Data for XLSX and worksheet2
                              header=False, index=False)
writer.save()                                                   # Save XLSX with the new worksheets
writer.close()													# Close writer";python
Checking if xlsx is open while trying to save;"while True:
    try:
        writer.save ()
        writer.close ()
        break
    except Exception as e:
        print (""Error: "", e)
		traceback.print_exc()
        input (""Datei kann nicht geöffnet werden - bitte schließen und <Enter> drücken!"")";python
Read column to a list;"mylist = []
for col in ws['A']:
     mylist.append(col.value)";python
Automatic adjustment of the columns accoring to best fit;"column_widths = []
ws = writer.sheets[stock]
for row in content:                                    # Determination of the longest value per column
    for i, cell in enumerate (row):
        if len (column_widths) > i:
            if len (str (cell)) > column_widths[i]:
                column_widths[i] = len (str (cell))
        else:
            column_widths += [len (str (cell))]
    for i, column_width in enumerate (column_widths):  # Col 0 and 1 with fixed length - rest according to longest value in col
        if i == 0:
            ws.column_dimensions[get_column_letter (i + 1)].width = 35
        elif i == 1:
            ws.column_dimensions[get_column_letter (i + 1)].width = 32
        else:
            ws.column_dimensions[get_column_letter (i + 1)].width = column_width + 2";python
import openpyxl.styles;from openpyxl.styles import Font, PatternFill, Border, Side, Alignment;python
import formatting, styles;from openpyxl import formatting, styles;python
bold font;bold = Font (bold=True);python
yellow background (use color picker);"bg_yellow = PatternFill (fill_type=""solid"", start_color='fbfce1', end_color='fbfce1')";python
grey background (use color picker);"bg_grey = PatternFill (fill_type=""solid"", start_color='babab6', end_color='babab6')";python
blue background (use color picker);"bg_green = PatternFill (fill_type=""solid"", start_color='8af542', end_color='8af542')";python
define border on very side;"frame_all = Border (left=Side (style='thin'), right=Side (style='thin'),
                    top=Side (style='thin'), bottom=Side (style='thin'))";python
border only on top and bottom;frame_upanddown = Border (top=Side (style='thin'), bottom=Side (style='thin'));python
font size 14;"size14 = Font (bold=True, size=""14"")";python
define left alignment;"left_allign = Alignment (horizontal=""left"")";python
define right alignment;"right_allign = Alignment (horizontal=""right"")";python
define right alignment for area;"for row in ws[""D1"":""G34""]:
    for cell in row: cell.alignment = right_allign";python
define full border for several areas;"areas = [""A7:G19"",""A27:G31""]";python
format area;"for area in areas:
    for row in ws[area]:
        for cell in row:
			cell.border = frame_all
			cell.number_format = ""0""															=> define number format without decimals
			cell.number_format = ""0.000E+00""													=> define number format with 3 decimals";python
set background and size for several specific cells;"for i in [""A6"",""D6"",""E6"",""A26"",""D26"",""E26""]:
    ws[i].fill = bg_green
    ws[i].font = size12";python
freeze worksheet at cell B2 for right and down scrolling;"freeze = ws[""B2""]
ws.freeze_panes = freeze";python
fit xlsx to one page for printing - 1st part;ws.sheet_properties.pageSetUpPr.fitToPage = True;python
fit xlsx to one page for printing - 2nd part;ws.page_setup.fitToHeight = False;python
set page to landscape horizontal;ws.set_printer_settings(paper_size=1, orientation = 'landscape');python
set page to landscape horizontal;ws.set_printer_settings(paper_size=1, orientation = 'portrait');python
Define red color background;red_color = 'ffc7ce';python
Define red color font;red_color_font = '9c0103';python
Define red_font with size / bold / red color;red_font = styles.Font (size=14, bold=True, color=red_color_font);python
Define red_fill with color red / fill type solid;red_fill = styles.PatternFill (start_color=red_color, end_color=red_color, fill_type='solid');python
Define conditional formating for area, <0, fill with red background;"ws.conditional_formatting.add ('A1:Z100',
	formatting.rule.CellIsRule (operator='lessThan',formula=['0'],fill=red_fill))";python
Define conditional formating for area, <0, use red font;"ws.conditional_formatting.add ('A1:G25',
	formatting.rule.CellIsRule (operator='lessThan',formula=['0'],fill=red_fill,font=red_font))";python
Conditional formating for more than one area;"for area in [""B1:B100"",""C2:G100""]:
	ws.conditional_formatting.add (area, ...)";python
Conditional formating according to a formula;"ws.conditional_formatting.add('E1:E10',
	FormulaRule(formula=['ISBLANK(E1)'], stopIfTrue=True, fill=redFill))";python
Conditional formating according to a formula;"ws.conditional_formatting.add('D2:D10',
	FormulaRule(formula=['E1=0'], font=myFont, border=myBorder, fill=redFill))";python
Color Scale formating;"# Define rule
ruleBottomGreen = ColorScaleRule(
                        start_type='percentile', start_value=10, start_color=""63BE7B"", # green
                        mid_type='percentile', mid_value=50, mid_color= ""FFFB84"", # yellow
                        end_type='percentile', end_value=90, end_color=""F8696B"") # red
# Apply rule
ws2.conditional_formatting.add(f""K4:K12"", ruleBottomGreen)";python
Import module;import xlwings as xw;python
Use xlwings with hidden excel-worksheets;app = xw.App(visible=False);python
Create a new workbook;wb = xw.Book();python
Read XLSX;"wb = xw.Book (""name.xlsx"")";python
Read XLSX with password protection;"wb = xw.Book (""name.xlsx"", password(""xyz""))";python
Read specific worksheet;"ws = wb.sheets[""name_sheet""]";python
Read first worksheet;ws = wb.sheets[0];python
Add worksheet in workbook;"wb.sheets.add(""NewWS"")";python
Reads the formula of a cell (not the value);"f = ws[""A1""].formula";python
Assign formula to a cell;"ws[""A1""].formula = string";python
"Iterate trough cells an set them to """" / None";"for i in ws.range(""A3:A7""): i.value = """"";python
Sort worksheet in the first col (function see below);xl_col_sort(ws,1);python
Reads the color of a cell and returns a rgb-tuple eg. (146, 208, 80);"ws[""C8""].color";python
Set value for cell;"ws[""C8""].value";python
Read hyperlink of cell;"ws.range (""A2"").hyperlink";python
Set values for specific cell;"ws.range(""A1:C3"").value";python
Remove background from a cell;"ws[""C8""].color = None";python
White: Assigns background color for a range of cells;"ws.range(""A1:C3"").color = (255,255,255)";python
Green: Assigns background color;"ws.range(""A1:C3"").color = (149,237,173)";python
Red: Assigns background color;"ws.range(""A1:C3"").color = (237,149,149)";python
Yellow: Assigns background color;"ws.range(""A1:C3"").color = (240,232,146)";python
Orange: Assigns background color;"ws.range(""A1:C3"").color = (230,172,80)";python
Blue: Assigns background color;"ws.range(""A1:C3"").color = (143,157,235)";python
Assign numeric format with 2 decimals;"ws.range(""A1:C3"").number_format = ""0,00""";python
Assign percentage format with 2 decimals;"ws.range(""A1:C3"").number_format = ""0%""";python
Set cell to bold;"ws.range(""B1"").api.Font.Bold = True";python
Windows: Black: Set font color to black (see codes: https://access-excel.tips/excel-vba-color-code-list/);"ws.range(""B2"").api.Font.ColorIndex = 1";python
Windows: Red: Set font color to red (see codes: https://access-excel.tips/excel-vba-color-code-list/);"ws.range(""B2"").api.Font.ColorIndex = 3";python
Windows: Set font size to 16;"ws.range(""A1"").api.Font.Size = 16";python
Windwos: Set specific font;"ws.range(""A1"").api.Font.Name = ""Arial""";python
Mac: Set font color to dark grey;"ws.range(""B2"").api.font_object.color.set((105,105,105))";python
Autofit the columns;"ws2.autofit(axis=""columns"")";python
Autofit the columns and rows;ws2.autofit();python
Set wrap text to False;"ws2.range(f""A2:Z10000"").api.WrapText = False";python
Insert a hyperlink and define which text should be shown in the cell;"ws[""D5""].add_hyperlink(link, text_to_display = ""Chart"")";python
add an image at a specific cell;"wsInp.pictures.add(imgFN, left=wsInp.range(""D20"").left, top=wsInp.range(""D20"").top, height=100)";python
Get all the pictures of a worksheet in a list;ws.pictures;python
Delete the first picture in the worksheet;ws.pictures[0].delete();python
"Delete the first picture with the name ""xyz""";"ws.pictures[""xyz""].delete()";python
Disable auto filter in worksheet;ws.api.AutoFilterMode = False;python
Clears the content and formatting of the whole sheet;ws.clear();python
Clears the content but leaves formatting;ws.clear_contents();python
Read worksheetnames to list;l = [x.name for x in wb.sheets];python
Delete worksheet in workbook;"wb.sheets[""OldWS""].delete()";python
Hide worksheet in workbook;"wb.sheets[""WS""].api.Visible = False";python
Copy worksheet;ws.copy(name='copied');python
Save workbook;wb.save();python
Close workbook;wb.close();python
Quit App when opened at the beginning;wb.quit();python
Bring workbook to the front of the screen;wb.activate(steal_focus=True);python
Load elements in list from range which are not None;"[x for x in ws.range(""A3:A2000"").value if x != None]";python
copy range from one sheet to another;"ws.range(""A1:A10"").value = ws2.range(""A1:A10"").options(ndim=2).value";python
Move worksheet at the beginning;ws1.api.Move(Before=wsWork.api);python
Move worksheet at the end;ws1.api.Move(After=wsWork.api);python
Get address and subaddress from hyperlinks;"for l in ws1['H18'].api._inner.Hyperlinks:
  wAddr = l.address         # brings results for http-links
  wSubAddr = l.SubAddress   # brings results for internal file-links";python
Hide worksheet in windows;"app = xw.App()
wb = app.books.open(FN)
app.visible = False
ws = wb.sheets[0]";python
Definiton for border-sites see: https://docs.microsoft.com/en-us/office/vba/api/excel.xlbordersindex;"for e in ws.range(""B3:D3""):
  for site in [7,8,9,10]:
    e.api.Borders(site).LineStyle = 1";python
Update row / change whole row;"l = ws.range(""A2:A6"").value         # Read specific cells to list (eg. [2,4,6,7,8])
l = [0,1,2,3,4]											# Change list
ws.range(""A2:A100"").value = l       # Writeback the updates to cells";python
Update cell area / change 3 elements;"v = ws.range(""A2:F9"").value
v[3][2] = 9999999
v[5][1] = 8888888
v[7][5] = 5555555
ws.range(""A2:F9"").value = v";python
Sorting workssheet in given col;"def xl_col_sort(sheet,col_num):
    sheet.range((2,col_num)).api.Sort(Key1=sheet.range((2,col_num)).api, Order1=1)
    return";python
Delete several rows / columns;"from xlwings.constants import DeleteShiftDirection
ws.range('2:4').api.Delete(DeleteShiftDirection.xlShiftUp)      # delete rows 2 to 4
ws.range('A:C').api.Delete(DeleteShiftDirection.xlShiftUp)      # delete cols A to C";python
Import the module;import python-docx;python
Import the library;from docx import Document;python
Read file;doc = Document('file.docx');python
Save file;doc.save('file.docx');python
Read all tables;t = doc.tables;python
Access specific element in table;t[0].rows[0].cells[0].paragraphs[0].text;python
Assign style to specific paragraph;t[0].rows[0].cells[1].paragraphs[0].style;python
Read all paragraphs;p = doc.paragrapsh;python
Set the Normal style to specific font and size;"(assigning it to specific paragraph see above)
from docx.shared import Pt
style = document.styles['Normal']
font = style.font
font.name = 'Arial'
font.size = Pt(10)";python
Replace text and keep the previous style;"(iteration over runs necessary)
for para in doc.paragraphs:
  for run in para.runs:
    run.text = ""New Text""";python
Import Win32 Module;import win32com.client;python
Import OS Module;import os;python
Define Input-XLSX;"inp = os.getcwd() + ""\\"" +""excel.xlsx""";python
Define Output-PDF;"out = os.getcwd() + ""\\"" +""ws.pdf""";python
Initialize Excel Application;"o = win32com.client.Dispatch(""Excel.Application"")";python
Do everything hidden;o.Visible = False;python
Open XLSX;wb = o.Workbooks.Open(inp);python
Create PDF from the active worksheet in the xlsx;wb.ActiveSheet.ExportAsFixedFormat (0, out);python
Close XLSX;wb.Close(True);python
Number of Worksheets;wb.Sheets.Count;python
Select 3 different worksheets by number (for exporting afterwards);wb.WorkSheets ([3,4,8]).Select();python
Assign worksheet 4;ws = wb.Worksheets[4];python
No Zooming;ws.PageSetup.Zoom = False;python
Fit to 1 height;ws.PageSetup.FitToPagesTall = 1;python
Fit to 1 width;ws.PageSetup.FitToPagesWide = 1;python
Select specific print area;"ws.PageSetup.PrintArea = ""A1:G50""";python
Read PDF informations / metadata;"from PyPDF2 import PdfFileReader        # Import Module for PDF Reading
with open (fn, 'rb') as f:
    pdf = PdfFileReader (f)				# Read PDF informations
    info = pdf.getDocumentInfo ()		# Read PDF infos^
    number_of_pages = pdf.getNumPages ()    # Read number of pages
	print(info)							# Outputs all informations
	print(info.title)					# Outputs title of the pdf
	print(info.author)					# Outputs author of the pdf";python
Read Text from Pdf;"page = pdf.getPage (7)		# Select page 8
text = page.extractText ()	# Extract text
print (text)				# print (text";python
Split PDFs;"from PyPDF2 import PdfFileWriter		    # Import Module for PDF Writing
pdf_writer = PdfFileWriter()				# Create new instance of PDF writer
pdf_writer.addPage(page)                    # Add Page to writer
with open(output_filename, 'wb') as out:	# Write splitted PDF
	pdf_writer.write(out)";python
Merge PDFs;"from PyPDF2 import PdfFileMerger		    # Import Module for PDF Merging
pdf_merger = PdfFileMerger()				# Create new instance of PDF merger
pdf_merger.append(path)                     # Append Page for merging
with open(output_path, 'wb') as fileobj:	# Write merged PDF
	pdf_merger.write(fileobj)";python
Rotate clockwise;page.rotateClockwise(90);python
Rotate counter clockwise;page.rotateCounterClockwise(90);python
Overlaying / Watermarking two pages;page.mergePage(watermark_page);python
import the module;import pyodbc;python
Define connection and cursor for access-db;"FN = ""dataOdd.accdb""
path = os.path.abspath(os.path.dirname(sys.argv[0]))
fn = path + ""/"" + FN
msAccess = r""{Microsoft Access Driver (*.mdb, *.accdb)}""
connPath = f'Driver={msAccess};DBQ={fn};'
conn = pyodbc.connect(connPath)
cursor = conn.cursor()";python
Read data;"cursor.execute('select * from dataOdds')
for row in cursor.fetchall():
    print (row)";python
Insert data;"sql = ""INSERT INTO dataOdds ("" \
      ""[Date],"" \
      ""Name,"" \
      ""Links,"" \
      ""Fixture) "" \
      ""VALUES (?,?,?,?)""
cont = [
        datetime.today().date(),
        ""datetime"",
        ""ichbineinlink.html"",
        ""01:  -  Race Test Race""
       ]
cursor.execute(sql, cont)
conn.commit()";python
Update data;"sql = ""UPDATE dataOdds "" \
      ""SET Links = ? "" \
      ""WHERE Date = ? "" \
      ""AND Name = ? "" \
      ""AND Fixture = ?""
cont = [
        ""ABC"",
        ""2022-03-24"",
        ""Albury"",
        ""02:35  -  Race 1 Trackpix maiden showcase plate""
       ]
cursor.execute(sql, cont)
conn.commit()";python
Delete data;"### delete data
sql = ""DELETE FROM dataOdds "" \
      ""WHERE Date = ? "" \
      ""AND Name = ? "" \
      ""AND Fixture = ?""
cont = [
        ""2022-04-22"",
        ""ABCDEFGH"",
        ""01:  -  Race Test Race""
       ]
cursor.execute(sql, cont)
conn.commit()";python
Data where the MariaDB-database is stored;C:\Program Files\MariaDB 10.3\data;python
Data where the MySQL-database is stored;C:\ProgramData\MySQL\MYSQL Server 8.0\data;python
Shows the database-version in the column header;HeidiSQL - Datei / Verbindungsmanager;python
Transfer whole table from local db to hosted db;"right click on database / table to transfer and select ""export database as sql""
for ""output"" select eg. ""Server: A2Hosting"" (connection to the hosted server)
for ""database"" select eg. ""xyztec_stockdb"" (name from the db on the hosted server)
for ""data"" select ""replace existing data""
when format of table should be changed also select checkbox ""Drop"" at table (not database!)
press ""export"" (wait till the rows-column shows 100%)";python
see: https://manjaro.site/backup-mysql-database-using-heidisql/;"select DB - <Tools>, <Export Database as SQL>
select Drop-Checkboxes and Create-Checkboxes
Data: Delete + insert (truncate existing data)
Output: single .sql file
Filename: choose destination file and folder";python
Both modules have to be installed;pip install mysql, mysql.connector;python
Import module for mysql access;import mysql.connector;python
Define connection;"mydb = mysql.connector.connect (host=""localhost"",user=""root"",passwd=""pwd"")";python
Set Cursor on mySQL;mycursor = mydb.cursor();python
"Creates database ""db""";"mycursor.execute(""CREATE DATABASE db"")";python
Show databases and informations;"mycursor.execute(""SHOW DATABASES"")
    for db in mycursor: print(db)";python
Create new table with 2 cols;"mycursor.execute(""CREATE TABLE students (name VARCHAR(255),age INTEGER(10))"")";python
Show tables and informations;"mycursor.execute(""SHOW TABLES"") for tb in mycursor: print(tb)";python
Insert row in table with the 2 values using sql injection;"sqlFormula = ""INSERT INTO students (name, age) VALUES (%s, %s)""";python
Define a row with values to insert;"student1 = (""Rachel"", 22)";python
Execute the sql statement to add one row;mycursor.execute(sqlFormula,student1);python
Commit the change (otherwise no update will be saved to db);mydb.commit();python
Define more rows with values;"students = [(""Tom"", 22),(""Mark"", 29),(""Clara"", 52)]";python
Execute the sql statement to add more row (from list / tuple);mycursor.executemany(sqlFormula,students);python
"Select col ""age"" from table ""students""";"mycursor.execute(""SELECT age FROM students"")";python
Read all rows according the above select statement;myresult = mycursor.fetchall();python
Read one / first row according the above select statement;myresult = mycursor.fetchone();python
Output the read row / table informations;for row in myresult: print(row);python
Define select (greater than);"sql = ""SELECT * FROM students WHERE age > 25""";python
Define select (with like clausel);"sql = ""SELECT * FROM students WHERE name LIKE 'M%'""";python
Execute SQL;mycursor.execute(sql);python
Define select (with sql injection);"sql = ""SELECT * FROM students WHERE name = %s""";python
Execute SQL with parameters;"mycursor.execute(sql, (""Mike"", ))";python
"Update row where name = ""xyz""";"sql = ""UPDATE students SET age = 82 WHERE name='xyz'""";python
Limit the output to 5 rows;"sql = ""SELECT * FROM students LIMIT 5""";python
Limit the output toi 5 rows and starting with element 2;"sql = ""SELECT * FROM students LIMIT 5 OFFSET 2";python
Output content - ascending order;"sql = ""SELECT * FROM students ORDER BY name""";python
Output content - descending order;"sql = ""SELECT * FROM students ORDER BY name DESC""";python
"Delete row with name ""xyz""";"sql = ""DELETE FROM students WHERE name = 'xyz'""";python
Drop whole table (if exists helps if there no table anymore);"sql = ""DROP TABLE IF EXISTS students""";python
Reset auto-increment in a table;ALTER TABLE mytable AUTO_INCREMENT=0;python
Delete the data inside a table;TRUNCATE TABLE tablename;python
Delete the data AND the whole table-structure itself;DROP TABLE tablename;python
SELECT ticker name for specific ticker;"sql = ""SELECT tickerName FROM stock_main WHERE ticker=%s""   # Or Select * to get all values from the table
var = [(stockTicker)]
c.execute(sql,var)
data = c.fetchall()";python
SELECT maximum calcDate for specific ticker;"sql = ""SELECT max(calcDate) FROM scores WHERE ticker = %s""
var = [(stock)]
c.execute (sql, var)
lastCalcDate = c.fetchone()";python
INSERT new row in a table;"sql = ""INSERT INTO scores ("" \
    ""ticker,"" \
    ""calcDate,"" \
    ""stockName,"" \
    ""profitGrowth)"" \
    "" VALUES (%s,%s,%s,%s)""  # as many %s necessary as insert attributes
cont = [inputList]          # list with 4 elements
c.execute (sql, cont)
mydb.commit ()";python
UPDATE row in a table;"sql = ""UPDATE stock_statistics "" \
        ""SET "" \
        ""marketCap=%s,"" \
        ""EV=%s,"" \
        ""Ebitda=%s"" \
        "" WHERE ticker=%s AND ultimo=%s""
cont = [(valMarketCap,
        valEV,
        valEbitda,
        stockTicker,
        ultimo)]
c.executemany (sql, cont)
mydb.commit ()";python
DELETE row in a table;"sql = ""DELETE FROM scores"" \
    "" WHERE ticker = %s and calcDate = %s""
cont = [stock,dateElem]
c.execute (sql, cont)
mydb.commit ()";python
DELETE everything in a table;"sql = ""DELETE FROM scores""
c.execute (sql)
mydb.commit ()";python
Import MODULE;from sqlalchemy import create_engine;python
necessary to install - otherwise problems eg. with api-accesses to the db;pip install pymysql;python
Define access to the MySQL-DB (username, pw, dbname);"engine = create_engine(""mysql+pymysql: //user:pw@localhost/dbname?host=localhost?port=3306"")";python
Establish connection;conn = engine.connect();python
Read all existing tables from the databasen - returns list;engine.table_names();python
Read data from db - returns list with tupels as rows;"conn.execute(""SELECT * FROM actor"").fetchall()";python
Close connection at the end;conn.close();python
Close sql engine at the end;engine.dispose();python
Define object / table;"from sqlalchemy import Table, Column, Integer, String, Float, MetaData
meta = MetaData()
students = Table(
   'students',
   meta,
   Column('id', Integer, primary_key = True),
   Column('name', String(45)),
   Column('lastname', String(45)),
)";python
Create the table(s) according to the metadata-definition;meta.create_all(engine);python
name of the table => students;user_table.c.name;python
all column-names / keys as list => ['id', 'name', 'lastname'];user_table.c.keys();python
shows the primary key of the object;user_table.primary_key;python
Create INSERT / UPDATE / DELETE / SELECT statements;"students.insert()                                           # Creates INSERT Statement according due the whole students structure
	=> shows: INSERT INTO students (id, name, lastname, floatvar) VALUES (:id, :name, :lastname, :floatvar)
students.insert().values(name = 'Karan')                    # Creates INSERT Statement for specific attribute
	=> shows: INSERT INTO students (name) VALUES (:name)
students.update()                                           # Creates UPDATE Statement
	=> shows: UPDATE students SET id=:id, name=:name, lastname=:lastname, floatvar=:floatvar
students.delete()                                           # Creates DELETE Statement
	=> shows: DELETE FROM students
students.select()                                           # Creates SELECT Statement
	=> shows: SELECT students.id, students.name, students.lastname, students.floatvar  FROM students";python
Execute SQL command - INSERT;"conn = engine.connect()                                     # Insert one row
ins = students.insert().values (name = 'Brauneder', lastname = 'Karl')
result = conn.execute(ins)
result.inserted_primary_key                                 # Shows the inserted primary key
conn.execute(students.insert(), [                           # Insert more rows
   {'name':'Krankl', 'lastname' : 'Hans'},
   {'name':'Herzog','lastname' : 'Andreas'},
])";python
Execute SQL command - SELECT;"s = students.select()                                       # Creates select statement for SELECT *
result = conn.execute(s)                                    # Excenute select statement
for row in result: print(row)                               # Outputs the result rows for select
s = students.select().where(students.c.id > 10)             # Creates select statement with WHERE clausel";python
Execute SQL with Textual SQL;"from sqlalchemy.sql import text
t = text(""SELECT name FROM students"")
result = conn.execute(t)
for row in result: print(row)
t = text(""select students.name, students.lastname from students where students.name between :x and :y"")
result = conn.execute(t, x = 'A', y = 'L')                  # Select statement with where-parameters";python
Using Aliases;"from sqlalchemy.sql import alias, select
st = students.alias(""a"")
s = select([st]).where(st.c.id > 2)
conn.execute(s).fetchall()";python
Execute UPDATE statement;"conn = engine.connect()
stmt=students.update().where(students.c.lastname=='Khanna').values(lastname='Kapoor')
conn.execute(stmt)
s = students.select()
conn.execute(s).fetchall()";python
Execute DELETE statementconn = engine.connect();"stmt = students.delete().where(students.c.lastname == 'Khanna')
conn.execute(stmt)
s = students.select()
conn.execute(s).fetchall()";python
Import module;import sqlite3;python
Create / Connet to a database;"conn = sqlite3.connect(""address_book.db"")";python
Create a cursor (for working with the db);c = conn.cursor();python
Create a table in the database (if it not exists);;python
Create a table in the database (if it not exists);;python
Insert rows into database;"c.execute(""INSERT INTO tbl VALUES (:attr1,:attr2,:attr3)"",
		{
			""attr1"": field1.get(),
			""attr2"": field2.get(),
			""attr3"": field3.get()
		})";python
Select rows from database;"c.execute(""SELECT * FROM adresses"")";python
Delete row from database - get key from delete_box widget (eg. tkinter-module);"c.execute(""DELETE from addresses WHERE oid = "" + delete_box.get())";python
Fetch all rows;records = c.fetchall();python
Fetch only one row;c.fetchone();python
Fetch the first 50 rows;records = c.fetchmany(50);python
Commit Changes;conn.commit();python
Close Connection;conn.close();python
Import module datetime and timedelta;from datetime import datetime, timedelta;python
Import module dat;from datetime import date;python
Conversion string to datetime in format yyyy-mm-dd;"datetime.strptime(""2021-06-01"", ""%Y-%m-%d"")";python
"Conversion for date format eg. ""Apr 21, 2020""";"datetime.strptime(""Apr 21, 2020"", ""%b %d. %Y"")";python
"Conversion for utc format eg. ""14:42:46 UTC 2021-12-15";"datetime.strptime(s, ""%H:%M:%S UTC %Y-%m-%d"")";python
Conversion for time format hh:mm:ss;"datetime.strptime(""05:20:25"",""%H:%M:%S"")";python
Conversion datetime to string in format  yyyy-mm-dd;"datetime.strftime(dt, ""%Y-%m-%d"")";python
Convert dateformat from string in one line (1st from - 2nd to);"dt.strftime((dt.strptime(tmp,""%m/%d/%Y"")),""%Y-%m-%d"")";python
Check if variable is of type datetime.date or datetime.datetime;isinstance(x, date);python
Check if variable is of type datetime.datetime;isinstance(x, datetime);python
"Define date as ""2020-07-24""";date = date(2020,7,24);python
"Define date+time as ""2020-03-05 19:27:23""";dt = datetime(2020,3,5,19,27,23);python
Actual date+time in format 2020-06-09 20:11:13;"now = datetime.now().strftime(""%Y-%m-%d %H:%M:%S"")";python
Actual date in format 2020-06-09;"now = datetime.now().strftime(""%Y-%m-%d"")";python
Actual date in datetime format;tday = datetime.today();python
Actual date as date format;tday = datetime.today().date();python
Actual date as string format;tday = str(datetime.today().date());python
Convert datetime to date;date = dt.date();python
Year / month / day / hour / minute from the datetime;dt.year, dt.month, dt.day, dt.hour, dt.minute;python
Returns weekday (monday=1, sunday=7);tday.isoweekday();python
Return the calendar week-number;dt.isocalendar().week;python
Calculates last friday (+2 for FR, +1 SA, 0 SU, -1 MO, -2 TU, -3 WE, -4 TH);last_friday = day - timedelta(days=tday.isoweekday() + 2);python
Creates timedelta for 7 days;tdelta = timedelta(days=7);python
Creates timedelta for 1 minute;tdelta = timedelta(seconds=60);python
7 days are added to the actual day;tday + tdelta;python
Previous 1-day-back-date for date;newdate = date - timedelta(days=1);python
Timedelta for two dates;date2-date1;python
Difference in days;daysDiff = abs(dt2-dt1).days;python
Difference in minutes;minDiff = (date2-date1).total_seconds() / 60;python
Generate UNIX/ISO-format from datetime;datetime.fromisoformat('2020-07-10 02:00:00').timestamp();python
Generate UNIX/ISO-format from actual date;iso_dt = datetime.fromisoformat(str(datetime.now())).timestamp();python
Generate Datetime from UNIXISO-format;date = datetime.fromtimestamp(ts);python
Shows size of the list / tuple in bytes;sys.getsizeof(l) or sys.getsizeof(t);python
Convert float to hh:mm:ss datetime.timedelta;t = timedelta(days=0.786331018518518);python
Convert datetime.timedelta to float;f = t.total_seconds() / 86400;python
Using german names / deutsche namen for month- and day-names;"import locale
locale.setlocale(category=locale.LC_ALL,locale=""German"")";python
Check last day of month & first weekday of month;"import calendar
calendar.monthrange(year,month)                         # return tuple - 1st: weekday first day - 2nd: ultimo day";python
Check if date and timezone has summmer time / daylight time;"import pytz
def is_dst(dt=None, timezone=""UTC""):
    if dt is None:
        dt = datetime.utcnow()
    timezone = pytz.timezone(timezone)
    timezone_aware_date = timezone.localize(dt, is_dst=None)
    return timezone_aware_date.tzinfo._dst.seconds != 0
is_dst()													# False => UTC has no daylight time
is_dst(datetime(2019, 1, 1), timezone=""US/Eastern"")			# False => at this date US/Eastern has no daylight time
is_dst(datetime(2019, 4, 1), timezone=""US/Eastern"")			# True => at this date US/Eastern has daylight time
is_dst(datetime(2019, 1, 1), timezone=""CET"")				# False => at this date CET has no daylight time
is_dst(datetime(2019, 4, 1), timezone=""CET"")				# True => at this date CET has daylight time";python
Timing a specific activity;"import timeit
start = timeit.default_timer()                          # Start timer
stop = timeit.default_timer()                           # Stop timer
round(stop-start,2)										# Stopped time in seconds and rounded to 2 decimals
round((stop-start)/60,2)                                # Stopped time in minutes and rounded to 2 decimals
timeit.timeit(stmt=""[0,1,2]"",number=1000000)     		# Checking the time for creating the list for 1mio times";python
Countdown while waiting;"import time, import sys
time.sleep(3)                                           # Delay for 3 seconds
for i in range (30, 0, -1):                             # Delay for 30 seconds - countdown in one row
    sys.stdout.write (str (i) + ' ')                    # Countdown output
    sys.stdout.flush ()
    time.sleep (1)";python
Check which os system running;"from sys import platform
if platform == ""linux""                                  # Program is excecuting from Linux
if platform == ""win32"":                                 # Program ix excecuting from Windows
if platform == ""darwin"":                                # Program is excecuting from Mac";python
Read monitor resolution;"import ctypes
user32 = ctypes.windll.user32
screensize = user32.GetSystemMetrics(0),                # 1st parameter is width, 2nd parameter is height
    user32.GetSystemMetrics(1)";python
Wait for keystroke or x seconds;"TIMEOUT = 10                # time / seconds for waiting
startTime = time.time()
inp = None
print(f""Program finished - pls press <enter> to close the window or wait {round(TIMEOUT / 60, 2)} minutes..."")
while True:
    if msvcrt.kbhit():                          # continue when pressing a key
        inp = msvcrt.getch()
        break
    elif time.time() - startTime > TIMEOUT:     # continue when the time is running out
        break";python
Import Module;from currency_converter import CurrencyConverter;python
Import Module for rate-checks for specific date;from datetime import date;python
Read Function CurrencyConverter;c = CurrencyConverter();python
Convert 100 USD to AUD with for actual date;c.convert(100, 'USD', 'AUD');python
Convert 100 USD to AUD for date 2013-03-21;c.convert(100, 'USD', 'AUD', date=date(2013, 3, 21));python
Check begin and end-date for all rates for BGN;first_date, last_date = c.bounds['BGN'];python
Read all possible currencies in a set;c.currencies;python
Description about the module;https://pypi.org/project/pycountry/;python
Install moduel;import pycountry;python
List of all countries with several informations;list(pycountry.countries);python
"Searching for country-informatns for ""DE""";c = pycountry.countries.get(alpha_2='DE');python
Outputs => DE;c.alpha_2;python
Outputs => DEU;c.alpha_3;python
Outputs number of the coutnry => 276;c.numeric;python
Outputs full name of the country => Germany;c.name;python
"Outputs the official name => ""Federal Republic of Germany!";c.official_name;python
List of all currencies;list(pycountry.currencies);python
List of all languages;list(pycountry.languages);python
List of all historic countries which not more exists;list(pycountry.historic_countries);python
List of all subdivided countries;list(pycountry.subdivisiones);python
Import smtplib;import smtplib;python
Import MIMEText;from email.mime.text import MIMEText;python
SMTP-Server and port number from the mail provider (e.g. GMail);s = smtplib.SMTP('smtp.gmail.com', 587);python
Response 250 means connection is ok;print(s.ehlo());python
Response 250 means connection is ok;print(s.starttls());python
Not the real pw - only the app-generated pw from gmail;print(s.login('sender@gmail.com', 'xyz123'));python
Message of the email;"msg = MIMEText(""This is the text of the mail"")";python
One recipient;sender = ['sender@gmail.com'];python
One or more recipient;recipients = ['recip1@gmail.com'];python
Or more recipients;recipients = ['recip1@gmail.com','recip2@r-software.at'];python
Subject;"msg['Subject'] = ""Subject of Mail""";python
From;msg['From'] = sender;python
One or more recipients;"msg['To'] = "", "".join(recipients)";python
Sending email;s.sendmail(sender, recipients, msg.as_string());python
Closing connection;s.quit();python
Import module;from pathlib import Path;python
Current working directory;Path.cwd();python
Creates new folder (no error message if folder allready exists with exist_ok=True);"Path(""folder"").mkdir(parents=True, exist_ok=True)";python
define some folder;"path = Path(""some_folder"")";python
add some subfolders (eg. some_folder/sub_folder/sub_sub_folder);"path = path / ""sub_folder"" / ""sub_sub_folder""";python
make path absolute;path = path.resolve();python
get mac-adress from the actual pc;"from uuid import getnode as get_mac
mac = get_mac()";python
Import module;import os;python
Get the actual path;path = os.path.abspath(os.path.dirname(sys.argv[0]));python
Put all filenames to a list from the actual path;os.listdir(path);python
Shows alls attributs and methods of the library;print(dir(os));python
Change the directory;"os.chdir(""C:/temp"")";python
Current working directory;os.getcwd();python
Get actual user name;os.getlogin();python
Outputs the entire content of the current working dir;for f in os.listdir(): print(f);python
Outputs the elements seperated in name + extension;for f in os.listdir(): fn, ext = os.path.splitext(f);python
Change the filenmae;os.rename(filename, new_name);python
Cut and paste file from path1 to path2;os.rename(src, dst);python
Copy file from source to destination;"shutil.copyfile(""src"",""dst"")";python
Creates new folder (also possible with makedirs => is prefered);"os.mkdir(""folder"")";python
Creates new folder and subfolders;"os.makedirs(""folder/subfolder"")";python
Delete file;os.remove (file);python
Delete folder (prefered cause deleting is dangerous);"os.rmdir (""folder"")";python
Delete folder and subfolders;"os.removedirs (""folder/subfolder"")";python
Outputs the statistics of the file (size, modification time,...);"os.stat(""file"")";python
Outputs dirpath - all the dirs - and all the files;for dirpath,dir,files in os.walk(os.getcwd());python
Get home dir of the actual user;"os.environ.get(""HOME"")";python
Outputs only the filename => file.txt;"os.path.basename(""temp/file.txt"")";python
Outputs only the dir => temp/;"os.path.dirname(""temp/file.txt"")";python
"Outputs filename and dir as a tupel => (""temp/"",""file.txt"")";"os.path.split(""temp/file.txt"")";python
Checks if filename exists in the filesystem;"os.path.exists(""temp/file.txt"")";python
Checks if folder exists / element is a directory (in the actual dir);"os.path.isdir(""xyz"")";python
Checks if files exists / element is a file (in the actual dir);"os.path.isfile(""xyz"")";python
Join path together on every os-system (win,mac,linux);"os.path.join(path, ""URLS"", link)";python
Put all sub-folders to a list from the actual working dir;[x[0] for x in os.walk(path)][1:];python
Change file to hidden;os.popen('attrib +h ' + fn).read().close();python
Send file to trash (needs:);send2trash(filename);python
Put all files with path in a list from actual directory with all subdirs and Filtering;"listExtensions=[""jpg"",""jpeg"",""png""]
listImages = []
for dirpath,dir,files in os.walk(os.getcwd()):
  for f in files:
    if any(x in f.lower() for x in listExtensions):
      wFN = os.path.join(dirpath, f)
      listImages.append(wFN)";python
Find home-directory for the actual user;"from os.path import expanduser
home = expanduser(""~"")";python
Check if 2 folders are different;"from filecmp import dircmp
ergDiff = dircmp(path, toPath)          # compare 2 directories
if ergDiff.left_only: ...               # see all changed files on the left side";python
importing module;import logging;python
Create & Config - w overwrites every time;"logging.basicConfig(filename=""fn.log"",format='%(asctime)s %(message)s', filemode='w')";python
Level every log > INFO possible (but not DEBUG);"logging.basicConfig(filename=""fn.log"",level=logging.INFO)";python
getLogger-Name / Level / Time / Message;"...format=""%(name)""s-%(levelname)s:%(asctime)s-%(message)s";python
Creating an object with specific name;logger=logging.getLogger(logname);python
Setting the threshold of logger to DEBUG;logger.setLevel(logging.DEBUG);python
Debug message;"logger.debug(""Harmless debug Message"")";python
Info message;"logger.info(""Just an information"")";python
Warning message;"logger.warning(""Its a Warning"")";python
Error message;"logger.error(""Did you try to divide by zero"")";python
Critical error message;"logger.critical(""Internet is down"")";python
Example with 2 logging levels;"logger=logging.getLogger(__name__)							 # Creating an object with the name of the py-file
stream_h = logging.StreamHandler()							 # Defining a handler for streamdata in the console
file_h = logging FileHandler(""file.log""						 # Defining a handler for logging to a file
stream_h.setLevel(logging.WARNING)							 # Set Stream-Logging to Warning-Level
file_h.setLevel(logging.ERROR)								 # Set File-Logging to Error-Level
	=> Error-Messages will go to both stream and file - Warning-Messages only to stream and not to file
formatter = logging.formatter								 # Defining the format for outputting
	""%(name)s - %(levelname)s - %(message)s"")
stream_h.setFormatter(formatter)							 # Setting format for stream-logging
file_h.setFormatter(formatter)								 # Setting format for file-logging
logger.addHandler(stream_h)									 # Adding Stream-handler to logger
logger.addHandler(file_h)									 # Adding File-handler to logger";python
https://stackoverflow.com/questions/24505145/how-to-limit-log-file-size-in-python	# Explanation about handling;"from logging.handlers import RotatingFileHandler             # importing file handler
log_formatter = logging.Formatter('%(asctime)s               # Define format for output in logfile
    %(levelname)s %(funcName)s(%(lineno)d) %(message)s')
my_handler = RotatingFileHandler(logFile, mode='a',          # Define handler with maxBytes and backupCount
    maxBytes=5*1024*1024, backupCount=2, encoding=None,      # When the log grows more then maxBytes...
    delay=0)                                                 # ...itgenerates a new logfile-version
my_handler.setFormatter(log_formatter)                       # Setting the format
my_handler.setLevel(logging.INFO)                            # Setting the threshold of logger to INFO
logger = logging.getLogger('root')                           # Creating an object with name
logger.setLevel(logging.INFO)                                # Setting the threshold of logger to INFO
logger.addHandler(my_handler)                                # Define handler with definition above";python
Importing module;import unittest;python
Import the function which will be tested;from prg import func;python
Define the class for testing the function;class TestFunc(unittest.TestCase):;python
Define the first testcase - must begin with test*;def testcase1(self):;python
call the function;"erg = func(""x"",3)";python
check if result is ok;"self.assertEqual(""3x"")";python
starting the unittest;if __name__ == '__main__': unittest.main();python
Check if equal;self.assertEqual(a,b);python
Check if not equal;self.assertNotEquale(a,b);python
Check if true;self.assertTrue(x);python
Check if false;self.assertFalse(x);python
Check if i in list;self.assertIn(i,list);python
Check if i not in list;self.assertNotIn(i,list);python
and hide the *.env files in the .gitignore;"pip install python-dotenv
from dotenv import load_dotenv, find_dotenv
import os
load_dotenv(find_dotenv())
GMAIL_TOKEN = os.environ.get(""GMAIL_TOKEN"")";python
COUNTER;"from collections import Counter
colors = ['blue', 'blue', 'red', 'red', ""red""]
counter = Counter(colors)									# Creates dict with counts => {'red': 3, 'blue': 2} in ordered form
counter.most_common(1) 		                           		# Outputs the element with the most counts as tuple
counter[""red""})            		                            # Outputs the occurence of the value ""red"" => 3";python
NAMEDTUPLE;"from collections import namedtuple
Point = namedtuple(""Point"",""x,y"")							# Creates class with tumple
pt = Point(1,-4)											# Creates Point(x=1,y=-4)
print(pt.x, pt.y)											# Shows 1 and -4";python
ORDEREDDICT;"not necessary anymore in the newer python versions
is allready implemented in the regular dict-type)";python
DEFAULTDIC;"d = defaultdict(int)	# Create defaultdict and define default-type
d[""xyz""]				# No key error when when key not in the dict => default-type value 0 is outputed";python
DEQUE;"from collections import deque      # import collections deque module
d = deque()				# Create deque (optimized for working with elements at the end or beginning of the list)
d.append(1)				# Add element at the end
d.appendleft(2)			# Add element at the beginning
d.extend([1,2]			# Add list of elements at the end
d.extendleft([1,2])		# Add list of elements at the beginning (in reversed order so 2,1)
d.pop()					# Delete element at the end
d.popleft()				# Delete element at the beginning
d.clear()				# Clear entire list
d.rotate(2)				# Shift all elements 2 places to the right
d.rotateleft(-1)			# Shift all elements 1 place to the left";python
necessary for the func-operator;import operator;python
all combis for carthesian product => [(1,3),(1,4),(2,3),(2,4)];product([1,2],[3,4]);python
all with 3 elements => (0,0,0),(0,0,1),(0,1,0),(0,1,1), aso.;product([0, 1], repeat=3);python
"all combis of this 2 strings => [(""a"",""1""),(""a"",""2""),(""b"",""1""),(""b"",""2"")]";product('ab', '12');python
all different orderings => [(1,2,3),(1,3,2),(2,1,3),(2,3,1),(3,1,2),(3,2,1)];permutations ([1,2,3]);python
all different orderings with 2 elements => [(1,2),(1,3),(2,1),(2,3),(3,1),(3,2)];permutations([1,2,3],2);python
all possible combis for a defined length => [(1,2),(1,3),(1,4),(2,3),(2,4),(3,4)];combinations([1,2,3,4],2);python
all combis also with itself => [(1,1),(1,2),(1,3),(2,2),(2,3),(3,3)];combinations_with_replacement([1,2,3],2);python
accumulates every number with the next => [1,3,6,10];accumulate([1,2,3,4]);python
using operator .mul for multiplication every number the next => [1,2,6,24];accumulate([1,2,3,4], func=operator.mul);python
compares every entry to the maximum => [1,2,5,5,5];accumulate([1,2,5,3,4], func=max);python
gives interabel - groups by the func => True[1,2], False[3];groupby([1,2,3],key=func_smaller3);python
same thing - with a lambda operation => True[1,2], False[3];grougpy([1,2,3],key=lambda x: x<3);python
infinite loop starting at 10 (has to be ended with break sometimes);for i in count(10);python
infinite cycle through the list (has to be ended with break sometimes);for i in cycle([1,2,3]);python
infinite loop with 1;for i in repeat(1);python
loop with 1 for 4 times;for i in repeat(1,4);python
fastest way to change an column in a dataframe (over 400x faster then iterrows);df = df['col'].apply(lambda x: x.strip());python
Import numpy module with np abbreviation;import numpy as np;python
Define a numpy array (automatically with type int);a = np.array([1,2,3,4]);python
Multiindexing in arrays possible => gives array/[0.,1.,2.]);a[[0,2,-1]];python
Defines a numpy array with datatype float (and not int);np.array([1,2,3,4]),dtype=np.float);python
Defines a 2d numpy array;a = np.array([[1,2,3],[4,5,6],[7,8,9]);python
Returns dimension shape => (3,3);a.shape;python
Returns number of dimensions => 2;a.ndim;python
Returns total number of elements => 9;a.size;python
Gives / slices the second row => [4,5,6];a[1];python
Gives / slices the second row and first element => 4;a[1,0];python
Slices the first 2 rows => array([[1,2,3],[4,5,6]]);a[0:2];python
Slices all row with first 2 elements => array([[1,2],[4,5],[7,8]]);a[:,:2];python
Slices first 2 rows and first 2 elements => array([[1,2],[4,5]]);a[:2,:2];python
Slices first 2 rows and last element => array([[3],[6]]);a[:2,2:];python
Changes content of second row => array([[1,2,3],[9,9,9],[7,8,9]);a[1] = np.array([9,9,9]);python
Changes content of third row (for all elements) => array([[1,2,3],[4,5,6],[8,8,8]);a[2] = 8;python
Builds the sum of all elements => 45;a.sum();python
=> 5.0;a.mean();python
Return standard deviation => 2.58198889774344;a.std();python
Builds sum per columns => array([12,15,18]);a.sum(axis=0);python
Builds sum per rows => array([6,15,24]);a.sum(axis=1);python
Initialize numpy array with 5 zeros => array([0.,0.,0.,0.,0.]);np.zeroes(5);python
Initialize numpy array with 2x3 ones with int32 => array([[0,0,0],[0,0,0]]);"np.ones((2,3),dtype=""int32"")";python
Initialize np array with 2x2 with the value 99 => array([[99,99],[99,99]]);np.full((2,2,),99);python
Initialize a square matrix with len 3 => array([[1.,0.,0.],[0.,1.,0.],[0.,0.,1.]]);np.identity(3);python
Separate individual copy of the numpy array (no updates in both arrays);arr_b = arr_a.copy();python
Define 2d numpy array with 2,4 dimension;c = np.array([[1,2,3,4],[5,6,7,8]]);python
Reshape the numpy array to 4,2 dimension => [[1,2],[3,4],[5,6],[7,8]];c.reshape((4,2));python
Reshape the numpy array to 3d with 2,2,2 dimension => [[[1,2],[3,4]],[5,6],[7,8]]];c.reshape((2,2,2));python
Convert numpy datetime64 to str (can afterwards be converted with strptime to datetime;"dt = str(dt64).split(""T"")[0]";python
Build array with this range => array([0,1,2,3]);a = np.array(4);python
Changes +10 to each element => array([10,11,12,13]) (creates new array - no changing a);a + 10;python
Changes *10 to each element => array([0,10,20,30]) (creates new array - no changing a);a * 10;python
Changes the existing array a => array([100,101,102,103]);a += 100;python
Defines second array babab6;b = np.array([10,10,10,10]);python
Sums the 2 arrays to new array => array([10,11,12,13);a + b;python
Multiplicates the 2 arrays to new array => array([0,10,20,30);a * b;python
Make sinus of all entries;np.sin(b);python
Make cosinus of all entries;np.cos(b);python
Build array with this range => array([0,1,2,3]);a = np.array(4);python
Selecting items with boolean expressions - returns first and last element => array([0,3]);a[True,False,False,True];python
Use operation on the array => array([False,False,True,True]);a >= 2;python
Using operation for slicing => array([2,3]);a[a >= 2];python
Gives back all elements which are greater than the mean => array([2,3]);a[a > a.mean()];python
Gives back all elements which are NOT greater than the mean => array([0,1]);a[~(a > a.mean())];python
Gives back all elements which are equal to 0 OR 1 => array([0,1]);a[(a==0) | (a==1)];python
Gives back all elements which are <=2 and have no rest divided by 2 => array([0,2]);a[(a <= 2) & (a % 2 == 0)];python
Random 1d float array with 3 entries => eg. (0.8377, 0.8720, 0,7784);np.random.rand(3);python
Random 2d array 3 entries => [[0.27,0.91,0.54],[0.68,0.87,0.36],[0.05,0.64,0.16]];np.random.rand(3,3);python
Random 1d int array 3 entries => [0,8,8];np.random.randint(0,10,3);python
Random 2d int array 3x4 entries => [[2,6,4,5],[7,6,7,3],[7,0,4,0]];np.random.randint(0,10,(3,4));python
Random 2d int array 3x3 entries with values from 0 to 99;np.random.randint(100, size(3,3));python
Random 2d int array 3x3 entries with values from -4 to 7;np.random.randint(-4,8,size(3,3));python
Shuffeling a 2d list but only the first axes;np.random.shuffle(lst);python
Can reproduce the same results;np.random.seed(1);python
examples;https://gist.github.com/why-not/4582705;python
Import Module;import pandas as pd;python
Also importing numpy-module necessary;import numpy as np;python
Necessary for supressing performance warnings see below;import warnings;python
Show more information - count of the shown columns;pd.set_option('display.max_columns',11);python
Show more information - show all columns;pd.set_option('display.max_columns',None);python
Show more information - None is using the maximum width of the IDE;pd.set_option('display.width', None);python
Supress Performance Warnings;warnings.simplefilter(action='ignore', category=pd.errors.PerformanceWarning);python
Define a series;s = pd.Series([35,63,81,61,127,65,319]);python
Shows default-index in 1 row / values in 2 row - also the dtype: int64 at the bottom;print(s);python
Name the series (shows the name also when series i printed at the bottom;"s.name = ""G7 population in millions""";python
"Shows the dtype of the series => dtype(""int64"")";s.dtype;python
Values of the series => array([35,63,81,61,127,65,319]);s.values;python
Slicing element => 35;s[0];python
Shows the index of the series => RangeIndex(start=0, stop=7, step=1);s.index;python
Shows first index-value;s.index[0];python
Change the index of the series from default 0-6 to country-names;"s.index=[""CAN"",""FRA"",""GER"",""ITA"",""JPN"",""UK"",""USA]";python
Accessing now with the new index possible => 81;"s[""GER""]";python
Access with index still possible using iloc => 35;s.iloc[0];python
Access with index still possible using iloc => 319;s.iloc[-1];python
Multiple selecting possible => GER 81 and JPN 127;"s.[""GER"",""JPN""]";python
Multiple selecting with index using iloc possible => CAN 35 and USA 319;s.iloc[0,-1];python
"Multiple selecting with "":"" - upper element is included => CAN 35, FRA 63, GER 81";"s.[""CAN"":""GER""]";python
Add 10 for the every element in the series => ([45,73,91,71,137,75,329]);s + 10;python
Using boolean operation to output every element => GER 81, JPN 127, USA 319;s[s > 70];python
Using boolean operation to output countries > mean => JPN 127, USA 319;s[s > s.mean()];python
~ for not, | for or, & for and;logical operator which can be used;python
Changing the value of a series element => CAN 40;"s[""CAN""] = 40";python
Changing the value of the last element => USA 500;s.iloc[-1] = 500;python
Changing the value with a specific operation => CAN,FRA,ITA,UK are changed to 99;s[s < 70] = 99;python
Define a series with NaN values;s = pd.Series([1,np.nan,7];python
Check for NaN values in the series => False,True,False;d.isnull();python
Check for NOT NaN values in the series => True,False,True;s.notnull();python
Sum of not NaN values in the series => 2;s.notnull().sum();python
Sum of NaN values in the series => 1;s.isnull().sum();python
Outputs all entries which are not NaN;s.[s.notnull()];python
Delete all entries with NaN;s.dropna();python
Replace the NaN-values with 0;s.fillna(0);python
Replace the NaN-values with the meanvalue of the serie;s.fillna(s.mean());python
With forward-fill the NaN-values are replaced with the value before (if the first i gets NaN);"s.fillna(method=""ffill"")";python
With backward-fill the NaN-values are replaced with the value after (if the last i gets NaN);"s.fillna(method=""bfill"")";python
Returns the duplicates (only the first entry for the same is no duplicate - rest gets True);s.duplicated();python
Returns the duplicates (only the last entry for the same value is no duplicate - rest gets True);"s.duplicated(keep=""last"")";python
Returns the duplicates (when there are more than one value - all get flagged as duplicate with True);s.duplicated(keep=False);python
Duplicates get dropped (only the first entry remains);s.drop_duplicates();python
Duplicates get dropped (only the last entry remains);"s.drop_duplicates(keep=""last"")";python
Duplicates get dropped (no entry remains if there are duplicate entries for the value);s.drop_duplicates(keep=False);python
Sorting by value ascending;s.sort_values();python
Sorting by value descending;s.sort_values(ascending=False);python
Iterate through pandas series;for index, value in s.items():;python
"Get element from series - if not found is the result ""N/A""";"erg = s.get(""Entry"",""N/A)";python
Delete timezone from timestamp;.index.tz_localize(None);python
Convert pandas timestamp to datetime;dt = dt.to_pydatetime();python
Convert datetime to pandas timestamp;dt = pd.Timestamp(dt);python
Convert pandas timestamp to datetime;dt = dt.to_pydatetime();python
Convert a dataframe to a nested list (only values, without index);l = df.values.tolist();python
Convert a dataframe to a nested list including index;l = df.reset_index().values.tolist();python
Read first worksheet to dataframe;df = pd.read_excel(workFN, sheet_name=0);python
get specific row with title in index;"filt = (tmpDF.index == ""Total Assets"")";python
get specific row with title in index;tmpDF = tmpDF[filt];python
get the first entry of a series;tmpDF[tmpDF.columns[0]][0];python
add new column in dataframe at position 0 (column is name, value is content);"df.insert(loc=0, column=""A"", value=""XYZ"")";python
Shows all parameters for the reader;pf.read_csv?;python
Read csv into dataframe - first line will be col-names of the dataframe;"df = pd.read_csv(""fn.csv"")";python
Read csv into dataframe - no headerline (col names will be default numeric);"df = pd.read_csv(""fn.csv"",header=None)";python
""")							=> Read csv with sepeartor ""=>"" instead of the default "";""";"df = pd.read_csv(""fn.csv"",sep=""";python
Many operations can be directly done when reading the csv-file;"df = pd.read_csv(""fn.csv"",";python
=> no header in the csv available;header=None;python
=> name the columns;"names=[""Timestamp"",""Price""],";python
=> define which column will be the index;index_col=0,;python
=> read dates as date - and not as string;parse_dates=True,;python
=> treat this chars as NaN-values;"na_values[""?"",""-"",""""],";python
"=> assign specific datatype to the column ""Price""";"dtype={""Price"":""float""},";python
"=> decimal-point is "","" (and not ""."")";"decimal="","",";python
=> read also blank lines (as default they are ignored);skip_blank_lines=False),;python
=> use only the three columns when reading the csv (by position);usecols=[0,1,2],;python
=> use only the three columns when reading the csv (selected by name);"usecols=[""first"",""last"",""age""])";python
Write dataframe to csv;"df.to_csv(""fn2.csv"")";python
Read xlsx (first worksheet) into dataframe;"df = pd.read_excel(""file.xlsx"")";python
Read xlsx (first worksheet) into dataframe - without headers;"df = pd.read_excel(""file.xlsx"",header=None)";python
Read xlsx and define the first column as index of the dataframe;"df = pd.read_excel(""file.xlsx"",index_col=[0])";python
"Read xlsx (worksheet ""Prod"") into dataframe";"df = pd.read_excel(""file.xlsx"",sheet_name=""Prod"")";python
Read xlsx with the ExcelFile method;"ef = pd.ExcelFile(""file.xlsx"")";python
"Shows alle worksheet-names as a list => eg. [""Prod"",""Desc""]";ef.sheet_names;python
"Read/Parse the worksheet ""Prod"" in a dataframe";"df = ef.parse(""Prod"")";python
Write several dataframes to excel;"# Create a Pandas Excel writer using XlsxWriter as the engine.
writer = pd.ExcelWriter('basisReadData.xlsx', engine='xlsxwriter')

# Write each dataframe to a different worksheet.
quandlMain.to_excel(writer, sheet_name=""quandlMain""),
quandlMain2.to_excel(writer, sheet_name=""quandlMain_From2018_MRT"")

# Write also in this form
with pd.ExcelWriter(""example.xlsx"") as writer:
    df.to_excel(writer, sheet_name=""coinPrices"")

# Close the Pandas Excel writer and output the Excel file.
writer.save()";python
Establish connection to the sql-db;"conn = sqlite3.connect(""data.db"")";python
Read data from sql-db into dataframe;"df = pd.read_sql(""SELECT * FROM empl;"",conn)";python
Many operations can be directly done when reading the sql-db;"df = pd.read_sql(""SELECT * FROM empl;"",conn,
	index_col=""EmplID"",										    # define which column will be the index
	parse_dates[""BirthDate"",""HireDate""])			# read this columns as date";python
It is easier to read a complete table using sqlalechmy;from sqlalchemy import create_engine;python
Create SQL Alchemy engine;"engine = create_engine(""data.db"")";python
Establish connection with SQL Alchemy;connection = engine.connect();python
Read whole table with SQL-Alechmy (many things are auto-done - e.g. Indexing,Parsing);"df = pd.read_sql_table(""empl"",con=connection)";python
Writes dataframe to the sql-db (breaks when table allready exists);"df.to_sql(""data.db"",conn)";python
Writes dataframe to the sql-db (with droping the table before inserting);"df.to_sql(""Dadata.db"",conn,if_exists=""replace"")";python
Writes dataframe to the sql-db (with inserting new values to existing table);"df.to_sql(""data.db"",conn,if_exists=""append"")";python
Read html into dataframe;df = pd.read_html(html_string);python
Assign html-varialbe;"html_url""https://www.xyz.com""";python
Read html-link to dataframe;df = pd.read_html(html_url);python
Creates a dataframe from a list of dicts => [{...},{...},{...}];df = pd.DateFrame(l);python
Create a dataframe for a dict;"df = pd.DataFrame.from_dict(d, orient=""index"")";python
EXAMPLE;"https://www.freecodecamp.org/learn/data-analysis-with-python/data-analysis-with-python-course/pandas-condtitional-selection-and-modifying-dataframes
    Popl	HDI		Continent
CAN	35		0,913	America
FRA	64		0,888	Europe
GER	81		0,916	Europe
ITA 61		0,873	Europe
JPN 127		0,891	Asia
UK  65		0,907	Europe
USA 319		0,915	America";python
Initialize a dataframe with random ints with 5 rows and 2 columns;df = pd.DataFrame(np.random.randint(0,5,size=(5, 2)), columns=list('AB'));python
Create an empty dataframe;df = pd.DataFrame();python
Creates a dataframe from a list of dicts => [{...},{...},{...}];df = pd.DateFrame(l);python
Create a dataframe for a dict;"df = pd.DataFrame.from_dict(d, orient=""index"")";python
Check if datafram is empty;if df.empty:;python
Show the shape of the dataframe (rows, columns) => (7,3);df.shape;python
Info for columns (index,name,dtype) also count of NaN-values per column;df.info();python
Shows datatype of every column;df.dtypes();python
Several statistic for the dataframe (median,max,min,std,...);df.describe();python
Output of the first 5 rows per default;df.head();python
Output of the first 22 rows;df.head(22);python
Output of the last 5 rows per default;df.tail();python
Output of the last 22 rows;df.tail(22);python
Output of all column names;df.columns;python
Outputs the index;df.index;python
"Set index to column ""name""";"df.index = df[""name""]";python
Outputs the size of the dataframe;df.size;python
Resets the index to numeric (previous index exists as column);df.reset_index(drop=False);python
Resets the index to numeric (previous index is deleted);df.reset_index(drop=True);python
"Define ""Popl"" as new index - with inplace it is permanently saved";"df.set_index(""Popl"", inplace=True)";python
"Selecting Rows by index - showing the row with the index = ""CAN""";"df.loc[""CAN""]";python
Selecting Rows by position - showing the last row;df.iloc[-1];python
"Selecting Columns by title - showing the whole column ""Population"" for all rows";"df[""Popl""]";python
Output of alle values with their count;"dfMCI[""ReceivedTime""]= dfMCI[""ReceivedTime""].astype(str)    counts()";python
Output of alle values with their count in percent;"df[""Continent""].value_counts(normalize=True)";python
Showing cols Popl,Continent for all rows;"df[[""Popl"",""Continent""]]";python
Showing cols Popl,Continent for all rows - values divided by 100;"df[[""Popl"",""Continent""]] / 100";python
Show the rows from index CAN to ITA;"df.loc[""CAN"":""ITA""]";python
Show the rows from index CAN to ITA - only with the column1;"df.loc[""CAN"":""ITA"",""Popl""]";python
Show the rows from index CAN to ITA - only with the column1 + column3;"df.loc[""CAN"":""ITA"",[""Popl"",""Continent""]]";python
Show the columns col1 to col4 for all rows;"df.loc[:,""col1"":""col4""]";python
Show the columns col1 to col4 for 3 rows from index 0 to 2 (2 included);"df.loc[0:2,""col1"":""col4""]";python
Show the columns cols 1 and 3 for the rows from index 0 to 2 (2 included);"df.loc[0:2,[""col1"",""col3""]]";python
Show the 1st and last row => CAN,USA;df.iloc[0,-1];python
Show 2nd and 3rd row for all cols => FRA,GER / Popl,HDI,Continent;df.iloc[1:3];python
Show 2nd and 3rd row for 2nd col => FRA,GER / HDI;df.iloc[1:3,1];python
Show 2nd and 3rd row for 1st and 3rd column => FRA,GER / Popl,Continent;df.iloc[1:3,[0,2]};python
Show 2nd and 3rd row for the 2nd and 3rd col => FRA,GER / HDI,Continent;df.iloc[1:3,1:3];python
Returns GER,JPN,USA for all cols;"df.loc[(df[""Popl""] > 70	)]";python
"Returns GER,JPN,USA for col ""Popl""";"df.loc[df[""Popl""] > 70, ""Popl""]";python
"Returns GER,JPN,USA for cols ""Popl"" and ""Continent""";"df.loc[df[""Popl""] > 70, [""Popl"",""Continent""]]";python
Output of 2 columns for the column slice;"df[[""Open"",""Close""]][""2010"":""2020""]";python
Output specific rows and slice of columns;"df[df.index.isin([""2020"",""2019""])][hist.columns[0:4]]";python
Output specific rows and columns;"df[df.index.isin([""2020"",""2019""])][[""Open"",""Close""]]";python
Drops the row CAN;"df.drop(""CAN"")";python
Drops the rows CAN,JPN;"df.drop([""CAN"",""JPN""])";python
Drops the rows CAN,JPN (2nd method);"df.drop([""CAN"",""JPN""],axis=0)";python
Drops the rows CAN,JPN (3rd method);"df.drop([""CAN"",""JPN""],axis=""rows"")";python
Drops the cols Popl,Continent;"df.drop(columns=[""Popl"",""Continent""])";python
Drops the cols;df.drop(df.columns[1,2,5,9],axis=1);python
Drops the cols Popl,Continent (2nd method);"df.drop([""Popl"",""Continent""],axis=1)";python
Drops the cols Popl,Continent (3rd method);"df.drop([""Popl"",""Continent""],axis=""columns"")";python
Drops the whole dataframe;df.drop(df.index, inplace=True);python
Define series with same col-names as in the dataframe - with some correction values;"crisis = pd.Series([-10,-0,3],index=[""Popl"",""HDI""])";python
"Comines crisis-series to the df => all values in ""Popl"" -10 and ""HDI"" -0,3 in the df";"df[[""Popl"",""HDI""]] + crisis";python
Define new series for new column in dataframe;"langs = pd.Series(
	[""FR"",""DE"",""IT""],           # values of new column
	index=[""FRA"",""GER"",""ITA""],  # existing index in dataframe
	name= ""lang"")               # name of the new column";python
"Creates new column in the dataframe according to the series ""langs"" - other rows will get ""NaN""";"df[""lang""] = langs";python
"Values of all rows in the column ""lang"" will be changed to ""GB""";"df[""lang""] = ""GB""";python
Renames column names;"df.rename(columns={""Popl"":""POPL"",""Continent"":""CONT""})";python
Renames index names;"df.rename(index={""UK"":""UnKi"",""USA"":""US""})";python
"Creates new column by dividing col ""Popl"" with col ""HDI""";"df[""Popl_HDI""] = df[""Popl""] / df[""HDI""]";python
Different operations for the column in the dataframe;"df[""Popl""].median().max().min().sum().mean().qunatile()";python
Changes Timestamp-String to Timestamp-Type (eg. read from csv-file before);"df[""Timestamp""]=pd.to_datetime(df[""Timestamp""])";python
Plotting the dataframe using the mathlib-module;df.plot();python
Plot the dataframe;df.plot(figsize=(12,6));python
Plot the dataframe for the specific timeframe;"df.loc[""2017-12-01"":""2019-12-01""].plot(figsize=(12,6)))";python
Check for NaN values in the Dataframe => Matrix with True / False;df.isnull();python
Check for NOT NaN values in the Series => Matrix with True / False;df.notnull();python
Sum of NaN values per column;df.isnull().sum();python
Deleting all rows with at least one NaN value in it;df.dropna();python
Deleting all columns with at least one NaN value in it;df.dropna(axis=1);python
Deleting all rows where all columns are NaN;"df.dropna(how=""all"")";python
Deleting all rows where at least 3 columns are NOT NaN;df.dropna(thresh=3);python
Replace NaN values with text;"df.fillna(""missing"")";python
Replace NaN values with 0;df.fillna(0);python
With forward-fill NaN-values are replaced with the value before (axis=0 means vertical / per column);"df.fillna(method=""ffill"",axis=0)";python
With forward-fill NaN-values are replaced with the value before (axis=0 means horizontal / per row);"df.fillna(method=""ffill"",axis=1)";python
"Shows the existing values for the column => eg: ""M"",""F"",""D"",""?"" (M/F is correct and D/? is wrong)";"df[""Sex""].unique()";python
"Shows the count of each existing value in the column => eg. ""M"" 175, ""F"" 132, ""D"" 5, ""?"", 3 => so 8 wrong entries";"df[""Sex""].value_counts()";python
"Change all ""D"" values in the column to ""F""";"df[""Sex""].replace(""D"",""F"")";python
"Change all ""D"" to ""F"" and ""N"" to ""M"" in the column";"df[""Sex""].replace({""D"":""F"",""N"":""M""})";python
Find all the invalid values in the age-column => eg. greater than 100 is invalid entry;"df[df[""Age""] > 100]";python
Fixing the invalid values for age by dividing it to 100;"df.loc[df[""Age""]>100,""Age""]=df.loc[df[""Age""]>100,""Age""]/100";python
Defines new filter;"filt = (df[""col1""] == ""col1_val1"")";python
Defines new filter with several values;"filt2 = (df[""col1""].isin([""val1"",""val2"",""val3""]))";python
Defines new filter NOT with several values;"filt3 = (~df[""col1""].isin([""val1"",""val2"",""val3""]))";python
Defines new filter with a > operator;"filt4 = (df[""col1""] > 123)";python
Outputs the result for the above filter;df[filt];python
Outputs the result for the above filter with only col2;"df[filt][""col2""]";python
Use 2 filters;df[filt1 & filt2];python
Filter the elements for the top 2.5% of the dataset (quantile);df= df[(df['value'] >= df['value'].quantile (0.025))];python
Filter the elements for the bottom 2.5% of the dataset (quantile);df= df[(df['value'] < df['value'].quantile (0.975))];python
Check duplicates for all rows (only first entry is not flagged as True);df.duplicated();python
Check duplicates for all rows (only last entry is not flagged as True);"df.duplicated(keep=""last"")";python
Check duplicates for all rows (every entry is flagged as True);df.duplicated(keep=False);python
Check duplicates only for subset-col (only first entry is not flagged as True);"df.duplicated(subset=[""Name""])";python
Check duplicates only for subset-col (only last entry is not flagged as True);"df.duplicated(subset=[""Name""],keep=""last"")";python
Check duplicates only for subset-col (every entry is flagged as True);"df.duplicated(subset=[""Name""],keep=False)";python
"Split all the strings in the column at the blank-char ""_"" => eg. results [1987, M, US, 1]";"df[""Data""].str.split(""_"")";python
Split all the strings in the column at the blank-char and build seperate new columsn in the dataframe;"df[""Data""].str.split(""_"",expand=True)";python
"Check column if there exists an ""U"" in the string-values (True / False output as series) - also regex possible";"df[""Data""].str.contains(""U"")";python
Eliminate the whitespaces at the beginning and end for the string-values;"df[""Data""].str.strip()";python
"Replace / Deletes blanks "" "" in the string-values";"de[""Data""].str.replace("" "","""")";python
Function lower is used for the whole dataframe;df.apply(lambda x: x.lower());python
Function lower is used for the first 3 columns;"df.apply(lambda x: x.lower(), axis=""columns"")[0:3]";python
Sorting the new index ascending;df.sort_index(inplace=True);python
Sorting the columns in dataframe;df.reindex(sorted(df.columns), axis=1);python
Sorting by column ascending;"df.sort_values(by=""co1"")";python
Sorting by column descending;"df.sort_values(by=""co2"",ascending=False)";python
Sorting by 2 columns descending - first col1 and then col2;"df.sort_values(by=[""col1"",""col2""],ascending=False)";python
Sorting a series for one specific col descending;"df[""col1""].sort_value(ascending=False)";python
Change the column titles to uppercase;df.columns =) [x.upper() for x in df.columns];python
Function lower is used for the whole column;"df[""c1""] = df[""c1""].apply(lambda x: x.lower())";python
Change the names of the values - all others become NaN;"df[""c1""].map({""val1"":""val1new"",""val2"":""val2new""})";python
Change the names of the values - all others are not touched;"df[""c1""].replace({""val1"":""val1new"",""val2"":""val2new""})";python
New column at the end;"df[""cnew1""] = df[""c1""] + df[""c2""]";python
New column at the end;"df[""cnew1""] = df[""c1""] + df[""c2""]";python
Deleting 2 columns;"df.drop(columns=[""c1"",""c2""], inplace=True)";python
Add new row (all other cols are defined as NaN for the row);"df = df.append({""c1"":""val1""},ignore_index=True)";python
Outputs the 5 highest values in the column - only col1;"df[""col1""].nlargest(5)";python
Outputs the 5 highest values in the column - all columns;"df.nlargest(5,""col1"")";python
Outputs the 5 lowest values in the column - all columns;"df.nsmallest(5,""col1"")";python
Grouping according to col1;"col1_grp = df.groupby(""col1"")";python
Access to one value from the group;"col1_grp.get_group(""col1_value"")";python
Grouping col1 and output median for col2;"col1_grp[""col2""].median()";python
Grouping col1 and output median for col2 only for 3 group-values;"col1_grp[""col2""].median().loc[[""A"",""B"",""C""]]";python
Filtering all Values with 0;"non_zero = df[df[""col1""]!=0]";python
"Add new column with Y/N depending if the value in col ""Sales"" is > 50";"df[""newcol""]=[""Y"" if x > 50 else ""N"" for x in df[""Sales""]]";python
Change existing column with Y/N depending if the value in col is > 50;"df[""col""]=[""Y"" if x > 50 else ""N"" for x in df[""col""]]";python
Add/change column with 0/1 depending of calc of the variables x/y from 2 cols;"df[""c""]=[1 if (x/y>9) else 0 for x,y in zip(df[""c1""],df[""c2])]";python
Delete duplicate index entries in the dataframe;df = df[~df.index.duplicated(keep='first')];python
Convert a dataframe to a dict (https://stackoverflow.com/questions/26716616/convert-a-pandas-dataframe-to-a-dictionary);df.set_index('timestamp').T.to_dict('list');python
Select every 5th row;df.iloc[::5, :];python
Reset index form a dataframe with a new column from 0 to x;df = df.reset_index();python
Get the first row of the dataframe;df = df.iloc[:,0];python
Iterate trough dataframe with index and content / row;for index, row in df.iterrows():;python
Show all rows of the dataframe when printed;pd.set_option('display.max_rows', None);python
Change datetime64 column to datetime;"df[""col1""] = df[""col1""].dt.date";python
Convert datetime to pandas timestamp;dt = pd.Timestamp(dt);python
"Get the maximum from the 3 different columns and put it in the column ""max""";"df[""max""]=df[[""high-low"",""high-pc"",""low-pc""]].max(axis=1)";python
Changing a column with this lambda function (over 400x faster then using iterrows);temp = df['name'].apply(lambda x: x.strip());python
Add empty line to dataframe;df.append(pd.Series(np.nan), ignore_index=True);python
Delete rows where col1 = nan;"df = df[df[""col1""].notna()]";python
Delete rows where col1 < 10;"df = df[df[""col1""] < 10]";python
Merge 2 dataframes where the column order-id is ident;dfFinal = df1.merge(df2, on='order-id');python
Convert a dataframe to a nested list;l = df.values.tolist();python
"When there is some warning like ""A value is trying to be set on a copy of a slice from a DataFrame""";"change the access from eg.: df[""upperband""][current] = df[""upperband""][previous]
to: df.loc[current, ""upperband""] = df.loc[previous, ""upperband""]
(then there will be no more warning)";python
Import module as plotter plt;import matplotlib.pyplot as plt;python
Plot a line;plt.plot(x, x **2 );python
Plot another line (in the other direction);plt.plot(x, -1 * (x ** 2));python
Define x values;x_values = list(range(1000));python
Define y values / squares;squares = [x**2 for x in x_values];python
Plot diagram with x- and y-axes;plt.plot(x_values, squares);python
Plot 1st row, 2nd col in the 2nd diagram (any line after that will only access the 2nd diagram);plt.subplot(1,2,2);python
Sscatter diagram with x- and y-axes and line strenght = 5;plt.scatter(x_values, squares, s=5);python
Title with fontsize = 24;"plt.title(""Title"", fontsize=24)";python
X-Axe title with fontsize = 18;"plt.xlabel(""X-Axe"", fontsize=18)";python
Y-Axe title with fontsize = 18;"plt.ylabel(""Y-Axe"", fontsize=18)";python
Params describtion with fontsize = 10;"plt.tick_params(axis=""both"", which=""major"", labelsize=10)";python
Define scaling of axes;plt.axis([0,1100,0,1100000]);python
Colors from one shade to another with different params;"plt.scatter(x,y,c=squares,cmap=plt.cm.Blues,edgecolor=""none"", s=10)";python
Expoit the first point larger in green;"plt.scatter(x[0],y[0],c=""green"",edgecolor=""none"", s=100)";python
Expoit the last point larger in red;"plt.scatter(x[-1],y[-1],c=""red"",edgecolor=""none"", s=100)";python
Hide the complete x-axis description;plt.axes().get_xaxis().set_visible(False);python
Hide the complete y-axis description;plt.axes().get_yaxis().set_visible(False);python
Define custom figure size;plt.figure(dpi=128, figsize=(10,6));python
Show diagram;plt.show();python
Save diagram as png-picture-file;"plt.savefig(""example.png"",bbox_inches=""tight"")";python
Python specific documentation for selenium;https://selenium-python.readthedocs.io/locating-elements.html;python
Import WebDriver for url access;from selenium import webdriver;python
Import Options;from selenium.webdriver.chrome.options import Options;python
Import Service;from selenium.webdriver.chrome.service import Service;python
Import WebDriverWait (explizit waiting time);from selenium.webdriver.support.ui import WebDriverWait;python
Import EC (for expected conditions with waiting logic);from selenium.webdriver.support import expected_conditions as EC;python
Import By (for finding elements with By-logic);from selenium.webdriver.common.by import By;python
Import Keys (for keystroke handling);from selenium.webdriver.common.keys import Keys;python
Import Time-Library when there are delays needed;import time;python
Import Keys to send key-strokes;from selenium.webdriver.common.keys import Keys;python
Define chrome driver - with actual folder os.getcwd;driver = webdriver.Chrome(os.getcwd() + '/chromedriver');python
Throws exception when time for read is over 10 seconds;driver.set_timeout(10);python
Somtimes necessary to delay some work in progress;time.sleep(1);python
Encode url;link = urllib.parse.quote_plus(link);python
Open link;driver.get(link);python
get full unparsed html-code;driver.page_source;python
"Find element (input-element with id = ""passwd-id"")";"driver.find_element(By.XPATH, ""//input[@id='passwd-id']"")";python
Click on element by xpath (investigate - copy xpath);"driver.find_element(By.XPATH,""//*[@id='button']/input"").click()";python
"Fill field ""name"" with content ""x""";"driver.find_element(By.XPATH,""//*[@id='name']"").send_keys(""x"")";python
Other method to find element per xpath ();"driver.find_element(By.XPATH, ""//button[text()='Some text']"")";python
"Find Element according to a specific element eg. ""aria-label"" with text ""Post"" in a ""div""";"driver.find_element(By.XPATH,""//div[@aria-label='Post']"").click()";python
Clear / delete input field;"driver.find_element(""q"").clear()";python
Fill text in field and press enter;"driver.find_element(""q"").send_keys(""txt"" + u'\ue007')";python
Set text of element to xyz;"driver.execute_script('arguments[0].innerHTML = ""xyz"";', elem)";python
"Fill text in field (use css-selector to find element => input element with id ""myID"" in it)";"drv.find_element_by_css_selector(""input#myID"").send_keys(""txt"")";python
Search field for class;"driver.find_elements(By.CLASS_NAME, ""cl"")";python
Search field for tag;"driver.find_elements_by_tag_name(""tag"")";python
Search by (exact) link-text in an anchor-tag;driver.find_element_by_link_text('Continue');python
Search by (partial) link-text in an ancor-tag;driver.find_element_by_partial_link_text('Conti');python
Send single keyboard-elements <> chars (needs import keys);driver.send_keys(Keys.Backspace,Keys.ARROW_LEFT,Keys.ENTER);python
Send a PageDown-keystroke (eg. for scrolling to the very bottom of a page);driver.send_keys (Keys.PAGE_DOWN);python
Send an Return-keystroke (eg. for enter after data entries in fields);driver.send_keys (u'\ue007');python
Press enter and submit site;field.submit();python
Close driver (otherwise the windows will not close);driver.quit();python
Close the actual window;driver.close();python
Title of the html-site;driver.title;python
Back-Function in browser-history;driver.back();python
Forward-Function in browser-history;driver.forward();python
Refresh website;driver.refresh();python
Define an individual cookie;"cookie = {""name"": ""token"", ""value"": ""23874kljdsjhfaökldjs""}";python
Use Cookie;driver.add_cookie(cookie);python
Outputs a specific cookie;"driver.get_cookie(""token"")";python
Outputs all cookies;driver.get_cookies());python
Read current, actual url;driver.current_url;python
Switch to a frame-id (eg. a PopUp);"driver.switch_to.frame (""frame_id"")";python
Read active window name;act_window = driver.current_window_handle;python
Switch (back) to active window (eg. after working on the popup-frame or popup-window);driver.switch_to.window(act_window);python
Set window size to 600 wide and 1000 height;driver.set_window_size(600,1000);python
Minmize window;driver.minimize_window();python
ScrollDown in the window (maybe to the bottom of the site);"driver.execute_script(""window.scrollTo(0, 10000)"")";python
Open a new tab;"driver.execute_script(""window.open('');"")";python
Swich to first tab;driver.switch_to.window(driver.window_handles[0]);python
Switch between iframes;"waitWD.until(EC.presence_of_element_located((By.XPATH,""//iframe[@id='mainFrame']"")))
iframe = driver.find_element(By.XPATH, ""//iframe[@id='mainFrame']"")
driver.switch_to.frame(iframe)
driver.switch_to.default_content()";python
Wait till a specific element is loaded / clickable;"=> waiting as long as required - better then time.sleep
=> more possible conditions see https://selenium-python.readthedocs.io/waits.html#explicit-waits
wait = WebDriverWait (driver, 5)                                        # Define maximum wait time till the element is ready
wait.until(EC.presence_of_element_located((By.NAME, ""agree""))).click()  # Wait till element with name = ""agree"" is present and click afterwards
wait.until(EC.presence_of_element_located((By.ID, ""YDC-Col1"")))         # Wait till element with id = ""YDC-Col1"" is present
wait.until(EC.element_to_be_clickable((By.XPATH, ""//div[text()='Total revenues']""))).click()    # Wait till div-element with specific text is pressent and click";python
Use Selenium with chrome windows hidden;"os.environ['WDM_LOG_LEVEL'] = '0'     # with this seeting no output of log / messages using webdriver_manager.chrome
import undetected_chromedriver as uc
from selenium.webdriver.chrome.options import Options
from webdriver_manager.chrome import ChromeDriverManager
from fake_useragent import UserAgent
ua = UserAgent()
userAgent = ua.random
options = Options()
options.add_argument('--headless')
options.add_experimental_option ('excludeSwitches', ['enable-logging'])
options.add_argument(""start-maximized"")
options.add_argument('window-size=1920x1080')
options.add_argument('--no-sandbox')
options.add_argument('--disable-gpu')
options.add_argument(f'user-agent={userAgent}')
srv=Service(ChromeDriverManager().install())
# driver = webdriver.Chrome (service=srv, options=options)
driver = uc.Chrome (service=srv, options=options)
waitWebDriver = WebDriverWait (driver, 5)
link = ""https://www.google.com""
driver.get (link)";python
Define Real User Agent Header;"(avoid being blocked while scraping some data - keep it up to date from time to time)
see: https://www.scraperapi.com/blog/5-tips-for-web-scraping/
common user agent list: https://www.networkinghowtos.com/howto/common-user-agent-list/
latest user agent list: https://www.whatismybrowser.com/guides/the-latest-user-agent/
options.add_argument(""user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.106 Safari/537.36"")";python
Use Random User Agent Header;"https://stackoverflow.com/questions/49565042/way-to-change-google-chrome-user-agent-in-selenium

from fake_useragent import UserAgent
options = Options()
ua = UserAgent()
userAgent = ua.random
options.add_argument(f'user-agent={userAgent}')";python
Using XPath with Selenium;"https://www.guru99.com/xpath-selenium.html
Can be used to find the location of any element in a html- or xml document

Example:
wait = WebDriverWait(driver, 10)
tmpElem = wait.until(EC.element_to_be_clickable((By.XPATH, ""//span[text()='Top Grossing']"")))
tmpElem.click()

Xpath=//tagname[@attribute='value']
    // : Select current node
    Tagname: Tagname of the particular node.
    @: Select attribute.
    Attribute: Attribute name of the node.
    Value: Value of the attribute.

//input[@name='uid']                      # input-elem with name = ""uid""
//input[@type='text']                     # input-elem with type = ""text""
//label[@id='message23']                  # label-elem with id = ""message23""
//input[@value='RESET']                   # input-elem with value = ""RESET""
//*[@class='barone']                      # any elem with class = ""barone""
//td[text()='UserID']	                    # td-elem which has the text ""User-ID""
//a[@href='http://demo.guru99.com/']      # anchor with specific link
//img[@src='//xyz.com/img/java.png']      # img-elem with specific pic-link
(//button)[2]                             # select the second button on the page
//button[last()]                          # select the last button
(//p[@class='product']/span)[2]           # select the second span in the p-element with class =

//*[@type='submit' or @name='btnReset']         # any elem which has 2 OR conditions (for type and name)
//input[@type='submit' and @name='btnLogin'     # any elem which has 2 AND conditions (for type and name)

//*[contains(@name,'btn')]              # any elem which has ""btn"" somewhere in the name
//*[contains(@id,'message')]            # any elem which has ""message"" somewhere in the id
//*[contains(text(),'here')]            # any elem which has ""here"" somewhere in the text
//*[contains(@href,'orf')]              # any elem which has ""orf"" somewhere in the href-link
//select[contains(.,'Division')]        # select-element where some child has the text ""Division"" in it
//label[starts-with(@id,'message')]     # elem where id starts with ""message""

//*[@type='text']//following::input[1]              # select all following-elements which have input as tag and select the first elem
//*[text()='Enterprise Testing']//ancestor::div[2]  # find ancestor-elements with text and take the second one
//*[@id='java_technologies']//child::li[23]         # select all child elements with specific id and select the 23th one
//*[@type='submit']//preceding::input[1]            # select preceding (dt.: vorangegangene) input-elements and take the first one
//*[@type='submit']//following-sibling::input       # select following sibling which is input
//*[@id='rt-feature']//parent::div[5]               # select parent of the elem with id = ""rt-feature"" and take the 5th div
//*[@type='password']//self::input                  # select elem and use itself (only 1 element can be found)
//*[@id='rt-feature']//descendant::a[X]             # find all elements below (dt.: Nachfahren) and take the Xth one";python
Scroll to the very bottom of a site - eg. Twitter, Facebook, Stocktwits,...;"lenOfPage = driver.execute_script(""window.scrollTo(0, document.body.scrollHeight);var lenOfPage=document.body.scrollHeight;return lenOfPage;"")
match=False
while(match==False):
    lastCount = lenOfPage
    time.sleep(1)
    lenOfPage = driver.execute_script(""window.scrollTo(0, document.body.scrollHeight);var lenOfPage=document.body.scrollHeight;return lenOfPage;"")
    if lastCount==lenOfPage:
        match=True";python
When there are problems clicking an element on a page;"Method1:
element = driver.find_element_by_id('datePickerToggleBtn')
webdriver.ActionChains(driver).move_to_element(element ).click(element ).perform()

Method2:
element = driver.find_element_by_css('div[class*=""loadingWhiteBox""]')
driver.execute_script(""arguments[0].click();"", element)";python
Take a screenshot when something fails in headless mode;"try:
    ...
    do the whole selenium work...
    ...
except:
    driver.save_screenshot(""a.png"")";python
use locators in this order as suggested by Selenium contributors;"ID
name
className
linkText
partialLinkText
tagName
cssSelector
XPath";python
Solving some captchas - clicking for 10 seconds;"element = driver.find_element(By.XPATH,""//div[@id='px-captcha']"")
  action = ActionChains(driver)
  click = ActionChains(driver)
  action.click_and_hold(element)
  action.perform()
  time.sleep(10)
  action.release(element)
  action.perform()
  time.sleep(0.2)
  action.release(element)";python
Use only newest fake_useragent;"# install with
  # pip uninstall fake-useragent
  # pip install --force-reinstall ""git+https://github.com/robertsmd/fake-useragent.git@robertsmd-feature-only-newest-uas""
  see: https://github.com/hellysmile/fake-useragent/pull/122
  from fake_useragent import UserAgent
  userAgent = UserAgent(num_newest_uas=2).random";python
Download PDF-File to folder;"# create this option-setting when creating the driver
  ...
  DOCPath = os.path.join(path, ""WORK"")
  options = Options()
  options.add_experimental_option('prefs', {
    ""download.default_directory"": DOCPath,
    ""download.prompt_for_download"": False,
    ""download.directory_upgrade"": True,
    ""plugins.always_open_pdf_externally"": True
    })
  ...
  srv=Service(ChromeDriverManager().install())
  driver = webdriver.Chrome (service=srv, options=options)
  driver.get(workerPDF)";python
Import module for beautiul soap;from bs4 import BeautifulSoup;python
Import moduel for fake useragent;from fake_useragent import UserAgent;python
Define UserAgent;ua = UserAgent();python
Create random useragent;"ua.random								""t";python
Read url as page;"page = requests.get(""https://www.ariva.de/dax-30"")";python
"Read url as page with proxy like eg. ""https://10.10.1.11:1080""";page = requests.get(url,headers=headers,proxy=proxy);python
Read html-page with parser;"soup = BeautifulSoup (page.content,""html.parser"")";python
Read xml-page with parser;"soup = BeautifulSoup (page.content,""xml"")";python
find first a-tag in body;soup.body.a;python
Find all td-elements;"soup.find_all(""td""):";python
Find alle th- and td-elements;"soup.find_all([""th"",""td""])";python
Read all table rows for specific class;"soup.find_all(""tr"", class_=""arrow0""):";python
Find all div-elements with specific class;"soup.find_all(""p"", {""class"": ""payamntp""})";python
Find element with one of this 2 classes;"soup.find_all(""div"", {'class':['class1', 'class2']})";python
Read all table data cells with id and content;"for col_id, col_content in enumerate(result.find_all(""td"")):";python
Read all divs with specific class;"soup.find_all(""div"", class_=""col-xs-6"")";python
"Find div with id ""lj_div""";"soup.find(""div"", {""id"": ""lj_div""})";python
"Find (first) p with class ""line""";"soup.find(""p"", {""class"": ""line""})";python
Find element with specific text / string;"soup.find(""dt"", string=""In-App Purchases"")";python
General way to find string;"soup.find(""div"", string=re.compile('contributions'))";python
"Check if string nameSymbol_"" is part of the class-element";"soup.find(""small"", class_=re.compile(""nameSymbol_""))";python
Find elements for several tags;"soup.find_all([""strong"",""a"",""br""])";python
Found the parent div-element for a specific before find element;"erg2 = erg.find_parent(""div"")";python
Check if class has specific content;"if row.get(""class"") == [""ellipsis"", ""nobr"", ""new""]:";python
Read all links from href element;"for e in soup.find_all(""a""): e.get(""href"")";python
"Read all number from the field ""value""";"for e in soup.find_all(""a""): e.get(""value"")";python
Change all linebreak <br> in text to blank;"for lb in soup.findAll(""br""): lb.replaceWith("" "")";python
Read url from the image;url_i = rows[0].find('img')['src'];python
Read image as content;image = requests.get(f'https:{url_i}').content;python
Formated Output with html indentations;results.prettify();python
Check if specific text in soup text-output;"if ""Kein Zugriff"" in soup.text:";python
Reads everyting what is in the tbody-tag;soap.tbody;python
return direct child elements of a an element in a list;.contents;python
returns all direct childrens (as a generator object);.children;python
returns all descendants (nachfolger) as iterable;.descendants;python
return the parent-tag;.parent;python
return all parents (as a generator object);.parents;python
return the next sibling (going sideways / have the same parent);.next_sibling;python
return the previous sibling (going sideways / have the same parent);.previous_sibling;python
all following siblings as iterable;.next_siblings;python
all previous siblings as iterable;.previous_siblings;python
return next element;.next_element;python
return next elements (as a generator object);.next_elements;python
return previous element;.previous_element;python
return previous elements (as a generator object);.previous_elements;python
find the next ul-element;".find_next(""ul"")";python
find the previous ul-element;".find_previous(""ul"")";python
find only direct children of an element;".find_all(""div"", recursive=False)";python
returns the name of the tag;.name;python
get all strings from a tag in an iterable;.strings;python
get all (stripped) strings from a tag in an iterable;.stripped_strings;python
get all text directly below a tag;.find_all(text=True, recursive=False);python
Using the select selector;"# https://facelessuser.github.io/soupsieve/selectors/
soup.select(""div.class1.class2"")                => divs-elem which have both classes
soup.select(""div[class='table-container']"")     => div-elem which have only this class
soup.select('h1, p')                            => all h1- and p-elements
soup.select('body p')                           => p-elems in body
soup.select('div > p')                          => children p-elems in div
soup.select('h1 ~ p')                           => p-elems on the same level as h1
soup.select(':any-link')                        => any links which has a href-attribute
soup.select(':checked')                         => all checked elements (radio-buttons, checkboxes, option)
soup.select('p:first-child')                    => first child in a group
soup.select('span:first-of-type')               => firt child of a given type in a group";python
Define Real User Agent Header;"(avoid being blocked while scraping some data - keep it up to date from time to time)
see: https://www.scraperapi.com/blog/5-tips-for-web-scraping/
common user agent list: https://www.networkinghowtos.com/howto/common-user-agent-list/
latest user agent list: https://www.whatismybrowser.com/guides/the-latest-user-agent/
headers = {
    'User-Agent': '<copy from the above link>',
}
response = requests.get(url, headers=headers)";python
Read with Selenium when necessary due the specific homepage;"from bs4 import BeautifulSoup
from selenium import webdriver
link = ""https://www.gurufocus.com/stock/"" + stock + ""/summary""			# define the homepage to be scraped
options = Options()
options.add_argument('--headless')										# webpage will work in the back
options.add_experimental_option ('excludeSwitches', ['enable-logging'])
path = os.path.abspath (os.path.dirname (sys.argv[0]))					# works for alle platforms (Win,MacOs,Linux)
if platform == ""win32"":
	cd = '/chromedriver.exe'
elif platform == ""linux"":
	cd = '/chromedriver_linux'
elif platform == ""darwin"":
	cd = '/chromedriver'
driver = webdriver.Chrome (path + cd, options=options)					# Use chromedriver.exe to read website with the above options
driver.get (link)  														# Read link
time.sleep (2)  														# Wait till the full site is loaded";python
Wait for the specific element to load;"element = driver.find_element_by_id(""analyst-estimate"")
driver.execute_script(""arguments[0].scrollIntoView();"", element)

driver.execute_script(""return arguments[0].scrollIntoView(true);"",
  WebDriverWait(driver, 20).until(EC.visibility_of_element_located((
    By.XPATH, ""//div[@class='search-pagination']""))))


time.sleep (1)";python
Read page with html.parser and to the further scraping;soup = BeautifulSoup(driver.page_source, 'html.parser');python
Close the chromedriver window;driver.quit ();python
all searches also possible for more elements wiht find_elements_*;"driver.find_element_by id												# Search for a id in html
driver.find_element_by_name												# Search for name-field (eg. in input-tag)
driver.find_element_by_xpath											# Search by xpath of the element (right mouse blick in Chrome Dev Tools)
driver.find_element_by_link_text										# Search for (full) text within the tags
driver.find_element_by_partial_link_text								# Search for (part) text within the tags
driver.find_element_by_tag_name('h1')									# Search for a tag in html
driver.find_element_by_class_name(""cont"")								# Search for a specific class name in html
driver.find_element_by_css_selector('p.content')						# Search for tag and selector";python
Read the whole text of an article / element;"tmpText = soup.find(""article"", {""itemprop"": ""description""})
  if tmpText != None:
    wText = ""\n"".join(list(tmpText.stripped_strings)[1:])";python
import module requests;import requests;python
import module json;import json;python
Request api from the generated api-link;resp = requests.get (url);python
GET-request with payload and headers;"resp = requests.request(""GET"", url,
                        json=payload,
                        headers=headers)";python
Return the statuscode of the response;"resp.status_code
    # 200: ok
    # 201: resource created
    # 400: bad request (wrong or missing some informations)
    # 401: Unauthorized (requires some additonal permissions)
    # 404: Not Found (requested resource does not exist)
    # 405: Method Not Allowed (wrong HTTP Method - eg. POST instead of GET)
    # 500: Internal Server Error: something broken on the server site";python
shows the statuscode in textform (eg. OK, Not Found);resp.reasons;python
used headers for the request;resp.request.headers;python
header from the response;resp.headers;python
show the content-type of the resonse (eg. json, image/jpeg);"resp.headers[""Content-Type""]";python
response in text-form;resp.text;python
response in json-form;resp.json();python
Pretty-Print formatted json-file;print(json.dumps(resp,indent=4,sort_keys=True));python
Read the value for the 1 element and the attribute xyz;"result = api[0][""xyz""]";python
Using requests_html;"pip install requests-html                         => Install module
from requests_html import HTMLSession             => Import requests_html
s = HTMLSession()                                 => Define a html-session
r = s.get(url, headers=HEADERS)                   => Define response
r.html.find(""title"", first=True).text             => title of in the html-tag
r.html.find(""span#wob_tm"", first=True).text       => Span-value with id = ""wob_tm""
r.html.find(""div.clX"", first=True)                => Div-element with class = ""clX""
r.html.find(""div.clX span.clY"",first=True).text   => Span-element with class=""clY"" ind Div-element with class=""clX""";python
Using request to get the source code or text from a page;"resp = requests.get(""https://api.buyproxies.org/?a=showProxies&pid=175649&key=168281a74e7bb3f0dc0feb4f37ec6de5&port=12345"")
proxyList = resp.text.split(""\n"")";python
Using requests to download a file;"url = ""https://xyz.mp3""
doc = requests.get(url)
with open('work.mp3', 'wb') as f:
  f.write(doc.content)";python
Using requests for reading websites;"ua = UserAgent(verify_ssl=False)
userAgent = ua.random
HEADERS = {""User-Agent"": userAgent}
page = requests.get (link, headers=HEADERS)
page = requests.get(site,timeout=5)               => try to read the website for max 5sec
soup = BeautifulSoup (page.content, ""html.parser"")";python
Using requests to read image from web, save and build hashValue;"headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.76 Safari/537.36'} # This is chrome, you can set whatever browser you like
  resp = requests.get(img, headers=headers, stream=True)
  print(resp.status_code)
  with open(workerPic, 'wb') as f:
    shutil.copyfileobj(resp.raw, f)
  del resp
  img = Image.open(resp.raw)
  workihashImg = imagehash.average_hash(img)
  print(workihashImg)";python
install the scrapy module;pip install SCRAPY;python
creates the project and folder-structure;scrapy startproject indeedScraper;python
create tilesSpider.py with scrapy-template;scrapy genspider tilesSpider magnattiles.com;python
scrape a webpage in command line and use the console for further investigations;scrapy shell http://quotes.toscrape.com/random;python
"fetch a new site from an allready scraped page with ""scrapy shell"" before";"fetch(""newURL"")";python
shows the full html-code of the page;print(response.text);python
"select element ""small"" with class=""author"" and shows the html-code";"response.css(""small.author"").extract()";python
return only the text for the element+class for the first element;"response.css(""small.author::text"").extract()[0]";python
"return the text for the first element for span + class=""text""";"response.css(""span.text::text"").extract_first()";python
return all anchor-tag texts in a list;"response.css(""a.tag:lst:text"").extract()";python
"find elems a in li with class ""next"" and get the content from the href-element";"response.css(""li.next > a::attr(href)"").extract_first()";python
extract href from all anchor-tags inside div.quote => span => a;"response.css(""div.quote > span > a::attr(href)"").extract()";python
combine the url from the initial scrapy shell with the string-path;"response.urljoin(""/page/2/"")";python
read text-data when the response is i a json-format;data = json.loads(response.text);python
Create spider skeleton on command line (quotesName = spider-name, toscrape.com = site to scrape);scrapy genspider quotesNAME toscrape.com;python
run spider from command line;scrapy runspider quotesNAME.py;python
run spider and store result into items.json;scrapy runspider quotesNAME.py -o items.json;python
shows the duplicate elements which are filtered;'dupefilter/filtered': 50,;python
open scrapy shell;scrapy shell;python
get the first div-element with that class;"response.css(""div.product-item-info"").get()";python
"get the first li-element in the ul-element with class ""products""";"response.css(""ul.products li"")";python
"assign all div-elements with that class to the variable ""products""";"products = response.css(""div.product-item-info"")";python
outputs the number of alle div-elements with that class on the loaded page;len(products);python
from the products-variable get the first a-element with this class;"p.css(""a.product-item-link"").get()";python
return the text from the element (first a-element with this class);"p.css(""a.product-item-link::text"").get()";python
return the text from all elements (all a-elements with this class);"p.css(""a.product-item-link::text"").getall()";python
return the text from all elements (all span-elements with this class);"p.css(""span.price::text"").getall()";python
"return the text from the element (first span with class ""price"" and replace the €-symbol)";"p.css(""span.price::text"").get().replace(""€"","""")";python
return the link from the element (first href-link with this class);"p.css(""a.product-item-link"").attrib[""href""]";python
second way to the the href-value;"p.css(""a.product-item-link::attr(href)"").get(";python
"return value of attribut ""dpsku"" in the a-tag with class ""button""";"p.css(""a.button::attr(dpsku)"").get()";python
"start scrapy with the spider ""whisky""";scrapy crawl whisky;python
"run spider ""whisky"" and output result to json-file (overwrite the json-file)";scrapy crawl whisky -O whisky.json;python
same as above (only appending the results and not overwriting);scrapy crawl whisky -o whisky.json;python
outputing as csv;scrapy crawl whisky -O whisky.csv;python
outputing as xlsx (scrapy-xlsx must be installed + settings.py changed: https://pypi.org/project/scrapy-xlsx/);scrapy crawl whisky -O whisky.xlsx;python
"find element with class ""action  next"" (spaces have to be replaced with ""."")";"response.css(""a.action.next"").get()";python
store the link for the next page;"nextPage = response.css(""a.action.next"").attrib[""href""";python
go to next page and do parsing;yield response.follow(nextPage, callback=self.parse);python
automatic delay between requests;settings.py: AUTOTHROTTLE_ENABLED = True;python
The initial download delay;settings.py: AUTOTHROTTLE_START_DELAY = 5;python
The maximum download delay to be set in case of high latencies;settings.py: AUTOTHROTTLE_MAX_DELAY = 60;python
ignore robots.txt;settings.py: ROBOTSTXT_OBEY = False;python
set download-delay (to prevent site-checkings);settings.py: DOWNLOAD_DELAY = 3;python
when scraping with scrapy_selenium;"DOWNLOADER_MIDDLEWARES = {
    'scrapy_selenium.SeleniumMiddleware': 800
}
#Selenium
from shutil import which
SELENIUM_DRIVER_NAME = 'chrome'
SELENIUM_DRIVER_EXECUTABLE_PATH = r""C:\Users\Polzi\Documents\DEV\Python-Private\chromedriver.exe""
# '--headless' if using chrome instead of firefox
SELENIUM_DRIVER_ARGUMENTS = ['--headless']";python
get text (with div and a combination);"response.xpath(""//div[@class='vendor']//ancestor::a/text()"").get()";python
get href-value (from a element with class);"response.xpath(""//a[@class='next page-numbers']/@href"").get()";python
get the aria-label-value;"response.xpath(""//a/@aria-label).get()";python
"get href-element (from a element and existing selector ""tmp"")";"tmp.xpath("".//a/@href"").get()";python
Example spider;"import scrapy
class QuotesnameSpider(scrapy.Spider):
    name = 'quotesNAME'                                 # name of the spider
    custom_settings = {                                 # define custom settings - eg. encoding utf-8 for german umlaute
        ""FEED_EXPORT_ENCODING"": ""utf-8""
    }
    allowed_domains = ['toscrape.com']                  # allowed domains (no http in front of the domain)
    start_urls = ['http://quotes.toscrape.com/random']  # urls to scrape

    def parse(self, response):
        self.log(""I just visited: "" + response.url)     # info-output when program is running
        yield {                                         # store scraped informations in a dictionary
            ""author_name"": response.css(""small.author::text"").extract()[0],
            ""text"": response.css(""span.text::text"").extract_first(),
            ""tags"": response.css(""a.tag::text"").extract(),
        }";python
Example spider (with direct api-access on an infinite page);"import scrapy
import json

class QuotesScrollSpider(scrapy.Spider):
    name = 'quotesINFINITE'                                     # name of the spider
    apiURL = ""https://quotes.toscrape.com/api/quotes?page={}""   # standard URL with page variable
    start_urls = [apiURL.format(1)]                             # create the start-url with page = 1

    def parse(self, response):
        data = json.loads(response.text)                        # read the json-page
        for quote in data[""quotes""]:                            # iterate trough all quotes
            yield {                                             # return the needed values
                ""authorName"": quote[""author""][""name""],
                ""text"": quote[""text""],
                ""tags"": quote[""tags""]
            }
        if data[""has_next""]:                                    # check if next page has to be read
            nextPage = data[""page""] + 1
            yield scrapy.Request(url=self.apiURL.format(nextPage), callback=self.parse)";python
Import module;import ftplib;python
Create FTP instance;ftp = ftplib.FTP();python
Define encoding;"ftp.encoding = ""utf-8""";python
Connect to ftp-address;ftp.connect(ADDR);python
Login with username and password;ftp.login(USERNAME, PW);python
Change working directory eg. to tmp;"ftp.cwd(""tmp/"")";python
Show actual working directory;ftp.pwd();python
Show files in actual working directory;ftp.dir();python
Quit ftp instance;ftp.quit();python
Upload file with ftp;"with open(fn, ""rb"") as file:
  ftp.storbinary('STOR test.png', file)";python
Install Py Qt Designer;https://build-system.fman.io/qt-designer-download;python
Installation;pip install pyqt5;python
QtWidgets / Different Widgets;"import PyQt5.QtWidgets as qtw   # Import QtWidgets
qtw.QApplication                # Defines Application
qtw.QLabel                      # Defines Label
qtw.QWidget                     # Defines Widget
qtw.QHBoxLayout                 # Arranges horizontally from left to right
qtw.QVBoxLayout                 # Arranges vertically from top to bottom
qtw.QGridLayout                 # Arranges in grid from on x and y axes
qtw.QFormLayout                 # Field for forms - 1col are titles, 2col are fields,rbs,cb
qtw.QPushButton                 # Defines PushButton
qtw.QDialog                     # Module for dialog windows
qtw.QDialogButtonBox            # Module for button boxes in dialog windows
qtw.QLineEdit                   # Defines input field with text
qtw.QMainWindow                 # Module for main windows
qtw.QStatusBar                  # Module for status bar
qtw.QToolBar                    # Module for tool bar
qtw.QMessageBox                 # Module for Message Boxes
qtw.QCommandLinkButton          # Module for Command Link Button
qtw.QCheckBox                   # Module for CheckBox
qtw.QDialog                     # Module for Dial Widget
qtw.QFileDialog                 # Module for File Dialog";python
Main Window;"app = QApplication(sys.argv)                            # Create an instance of the application
w = QWidget()                                           # Initialize a window
w.setWindowTitle('Windows Title')                       # Title of the windows
w.setGeometry(200, 200, 380, 180)                       # Define windows (1:x-coord,2:y-coord,3:width,4:height)
w.move(50, 15)                                          # Place / move windows to coodinates 60,15
msg = QLabel('<h1>Hello World!</h1>', parent=window)    # Define label / message in format h1
msg.move(50, 15)                                        # Place / move labe to coordinates 60,15
windows.show()                                          # Show the application GUI - schedules a paint event
sys.exit(app.exce_())                                   # Start the app and close it with sys.exit";python
Layouts;"qhLayout = QHBoxLayout()                                # Defines horzontal box layout
qvLayout = QVBoxLayout()                                # Defines vertical box layout
qgLayout = QGridLayout()                                # Defines grid layout
qfLayout = QFormLayout()                                # Defines form layout
btn1 = qtw.QPushButton(self)                            # Define Push-Button
qhLayout.addWidget(btn1)                                # Add Button on Layout
qvLayout.addLayout(qhLayout)                            # Add horizontal Box Layout in vertical Layout
lbl = qtw.QLabel('Name:', self)                         # Define Label
inp = qtw.QLineEdit(self)                               # Define Input-Field
qfLayout.addRow(lbl, inp)                               # Add row in form (Label + Input-Field)
qgLayout.addWidget(QPushButton('Button1'),1,0)          # Defines one or more buttons and set it to position 1,0
qgLayout.addWidget(QPushButton('Button1'),2,1,1,2)      # Set buttons to position 2,1 and span it 1row/2cols
w.setLayout(layoutXY)                                   # Sets layout dimensions to window

=> Button / QPushButton";python
2nd method to assign a function (short method);btn = qtw.QPushButton(self, clicked = lambda: self.btnPressedCalc());python
btn = qtw.QPushButton(self, clicked = lambda: self.btnPressedCalc())   2nd method to assign a function (short method);=> Label / QLabel;python
Label / QLabel;=> Input-Field / QLineEdit;python
Input-Field / QLineEdit;=> ComboBox / QComboBox;python
Input-Field / QLineEdit;=> List / QListWidget;python
Input-Field / QLineEdit;=> SpinBoxes / QSpinBox, QDoubleSpinBox;python
Add SpinBox to layout;layout.addWidget(sp);python
Add SpinBox to form-layout;"layout.addRow(""Name:"",sp)";python
"layout.addRow(""Name:"",sp)         Add SpinBox to form-layout";=> Textfield / QTextEdit;python
"layout.addRow(""Name:"",sp)         Add SpinBox to form-layout";=> RadioButtons / QRadioButton;python
RadioButtons / QRadioButton;=> CheckBoxes / QCheckBox;python
CheckBoxes / QCheckBox;=> DialWidget / QDial;python
CheckBoxes / QCheckBox;=> Statusbar;python
Statusbar;=> MessageBox;python
MessageBox;=> FileDialog / QFileDialog;python
FileDialog / QFileDialog;"# 3rd parameter: which files can be selected eg. ""All Files"" for all files
  # returning a tuple (name of the file and selected extension)";python
FileDialog / QFileDialog;fName[0]    # to get only the choosen filename;python
Menu or Icon / QAction;"self.menu = qtw.QAction(MainWindow)
  self.menu.triggered.connect(self.actPressedOpen)    => Set Function which should run when the menu is clicked";python
PyQt5Designer;"pip install PyQt5Designer                 # Install PyQt5Designer
designer.exe                              # Find designer.exe in installed venv
<Form><Preview>                           # Show preview of the designed window
pyuic5 -x filename.ui -o filename.py      # Convert Qt-Designer file to a python-file";python
QtGui / Change GUI like font, size;"import PyQt5.QtGui as qtg                               # Import Gui for changing fontsize
nameLabel.setFont(qtg.QFont(""Helvetica"", 18))           # Change font of the label";python
Click button one window to open another window;"from Window2from24 import Ui_SubWindow      # import Class / Window from other py-file
  from Dialog24 import Ui_Dialog              # import Class / Dialog from other py-file
  ...
  def openWindow(self):
    self.window = QtWidgets.QMainWindow()     # Which widget should be opened QMainWindow / QDialog
    self.ui = Ui_SubWindow()                  # Class Name of the window which sould be opened
    self.ui.setupUi(self.window)
    self.window.show()
    self.ui.label.setText(""New"")              # Access some elements on the opened window
  ...
  self.pb.clicked.connect(self.openDialog)    # call the function where the window is opened
  self.pb2.clicked.connect(self.openWindow)   # call the function where the dialog is opened";python
Load ui-file in py-file;"uic.loadUi(""27LoadUIFile.ui"",self)            # load the ui-file
self.l = self.findChild(qtw.QLabel, ""label"")  # assign label from ui
self.btn = self.findChild(qtw.QPushButton, ""pushButton"")    # assign push button from ui";python
Simplest App;"import PyQt5.QtWidgets as qtw
class MainWindow(qtw.QWidget):
  def __init__(self):
    super().__init__()
    self.setWindowTitle(""Name XY"")
if __name__ == '__main__':
  app = qtw.QApplication(sys.argv)
  mw = MainWindow()
  mw.show()
  sys.exit(app.exec_())";python
Tutorial with deep explanation;https://www.youtube.com/watch?v=YXPyB4XeYLA;python
Import tkinter module;from tkinter import *;python
Create root window;root = Tk();python
Name of the window in the title;"root.title(""Header Title"")";python
Define icon for the windows (left upper corner);"root.iconbitmap(""pic.ico"")";python
Define size of the window;"root.geometry(""400x400"")";python
Creating a label widget;"myLabel = Label(root,text=""Hello World!"")";python
Showing myLabel on the screen;myLabel.pack();python
Showing myLabel on grid place 0/0 (left upper corner) with 10pixel padding from above;myLabel.grid(row=0,column=0,pady=10);python
Creating a status label widget with border (bd=1), sunken relief and anchor position right (east);"status = Label(root,text=""St"",bd=1,relief=SUNKEN,anchor=E";python
Showing status bar - with using maximum space from left to right (west to east) with sticky;status.grid(row=2,column=0,columnspan=3,sticky=W+E);python
Creating a button widget with a name;"myButton = Button(root,text=""Click Me!"")";python
Creating a deactivated, greyed button widget with a name;"myButton = Button(root,text=""Click Me!"",state=DISABLED)";python
Creating a button widget with a name and size 50 * 50;"myButton = Button(root,text=""C"",padx=50,pady=50)";python
Creating a button which will excute the myfunc-function when its clicked;"myButton = Button(root,text=""T"",command=myfunc)";python
Creating a button which will excute the func-function with a numeric parameter;"myButton = Button(root,text=""T"",command=lambda: func(nr))";python
Creating a button with background blue and foreground white;"myButton = Button(root,text=""col"",bg=""blue"",fg=""white"")";python
Create a quit-button on the window;"QuitButton = Button(root,text=""exit"",command=root.quit)";python
Creating a entry field - with width 50 and borderwidth 5 - and showing the field;myEntry = Entry(root, width=50, borderwidth=5).pack();python
Showing myEntry as grid in row/col = 0/0 and spanned over 3 columns;myEntry.grid(row=0,column=0,columnspan=3);python
Showing myEntry as grid in row/col = 0/0 and with pading in x/y-axes;e.grid(row=0,column=0,padx=10,pady=10);python
Read content of the entry field;myEntry.get();python
Shows a default value in the entry field;"myEntry.insert(0,""Default-Text"")";python
Insert a number into the entry field;myEntry.insert(0, number);python
Delete content of the entry field;myEntry.delete(0,END);python
Mainloop of the program;root.mainloop();python
"Close window ""wind""";...command=wind.destroy;python
Pics in Tkinter-Windows;"from PIL import ImageTk,Image								# Additional module Pillow neede (install with <pip install Pillow>
my_img = ImageTk.PhotoImage(Image.open(""demo.png""))			# Reads Image wiht Pillow-module (Tkinter can not read png/jpg files)
my_label = Label(image=my_img)								# Creating a Label with the image
my_label.pack()												# Showing the pic";python
Define Frame;"frame = LabelFrame(root,text=""Name_Frame"",padx=5,padx=5)	# Creating a frame with padding 5/5 (inside the frame)
frame.pack(padx=10,pady=10)									# Showing the frame with padding 10/10 (outside the frame)
button = Button(frame,text=""Name_Button"")					# Creating button in the frame (not root window)
button.grid(row=0, column=0)								# Showing the button in the frame as grid (with frames is mixing between pack and grid possible)";python
RadioButtons;"r = IntVar()												# Define variable for radio button - when string use StringVar()
r.set(""2"")													# Choose default radio button
Radiobutton(root,text=""Opt1"",variable=r,value=1).pack()		# Define and show radiobutton 1
Radiobutton(root,text=""Opt2"",variable=r,value=2).pack()		# Define and show radiobutton 2
r.get()														# Get value from choosen radio button";python
MessageBox;"messagebox.showinfo(""Title of PopUp"", ""Hello World!"")		# Show Messagebox
different boxes available: showinfo, showwarning, showerror, askquestion, askokcancel, askyesno
response = messagebox.askquestion (""Bla"", ""BlaBla!"")		# Show AskQuestion Box and store response";python
Check about response of user in message box;"if response == 1: Label(root, text= ""YES"").pack()
elif response == 0: Label(root, text= ""NO"").pack()";python
More Windows;"def open()													# Function for opening the 2nd window
	global my_img											# Global definition necessary - otherwise no pic would be drawn
	sec = TopLevel()										# Define 2nd window
	sec.title(""2nd Window"")									# Title for 2nd window
    img = ImageTk.PhotoImage(Image.open(""demo.png""))		# Define image
    Label (top, image=img).pack()							# Show image in 2nd window
btn=Button(root,text=""Open 2nd Window"",command=open).pack()	# Button for opening 2nd window per click";python
FileDialog;"root.filename = filedialog.askopenfilename(					# Define filname dialog
    initialdir=""/Users/Bla/images"",							# Define initial dir for the file dialog
    title=""Select file"",									# Title of the file dialog
    filetypes=((""png files"",""*.png""),(""all files"",""*.*"")))	# Define filetypes in dialog (first name, second which files, default first entry)
my_label = Label(root, text=root.filename).pack()			# After choosing a file - show the filename + filepath";python
Slider;"vertical = Scale(root,from_=0,to=200)						# Define vertical slider
vertical.pack()												# Showing vertical slider
horizontal = Scale(root,from_=0,to=200,orient=HORIZONTAL)	# Define horizontal slider
horizontal.pack()											# Showing horizontal slider";python
Checkboxes;"Checkbutton(root,text=""Check1"",variable=var).pack(			# Define and Show a checkbox
c.select() or c.deselect()									# Select or Deselect per default the checkbox";python
DropDown;"options=[""Mo"",""Tu"",""We"",""Th"",""Fr""]							# Define options for dropdown menue
var = StringVar()											# Define variable for dropdown menue
var.set(""Mo"")												# Set default for dropdown menue
OptionMenu(root,var,*options).pack							# Define dropdown menue";python
https://kivy.org/#home;Kivy documentation;python
https://www.youtube.com/watch?v=dLgquj0c5_U&list=PLCC34OHNcOtpz7PJQ7Tv7hqFBP_xDDjqg;Training from;python
python -m pip install kivy[base] kivy_examples;Install kivy;python
Use template.spec (create with: pyinstaller *.spec - creation not as onefile possible with pyinstaller);Create EXE;python
Simple Window with Label;"import kivy                         # Import kivy base
from kivy.app import App            # Import App
from kivy.uix.label import Label    # Import Label class

class MyApp(App):                   # Define App-Class
    def build(self):
        return Label(text=""Hello"", font_size = 72)  # Print label with font_size 72)

if __name__ == ""__main__"":          # Start App / draw windows with label
    MyApp().run()";python
Input fields and button with Grid-Layout;"from kivy.uix.gridlayout import GridLayout      # Import Grid-Layout class
from kivy.uix.textinput import TextInput        # Import TextInput class
from kivy.uix.button import Button              # Import Button class

class MyGridLayout(GridLayout):                 # Define Grid Layout
    def __init__(self, **kwargs):                       # Initialize infinite keywords
        super(MyGridLayout,self).__init__(**kwargs)     # Call grid layout constructor
        self.cols = 2                                   # Set columns to 2 (draws all elements in 2 columns)

        self.add_widget(Label(text=""Name: ""))           # Add Label-Widget with text=""Name"" (as one-liner)
        self.name = TextInput(multiline=False)          # Add Input Box ""name"" with only one line (multiline = True would me more input lines)
        self.add_widget(self.name)                      # Assigment as two-liner

        self.submit = Button(text=""Submit"", font_size=32)   # Add Button-Widget with text=""Submit"" and font-size 32
        self.submit.bind(on_press=self.press)               # Bind the button to a function (when pressed the function press will be called)
        self.add_widget(self.submit)

    def press(self,instance):
        print(self.name.text)   # Print the text of the name-input field in the terminal
        self.add_widget (Label (text=f""New Label with text {self.name.text}"")       # Create new Label and write the text to it";python
Combine 2 Grids with 2 columns and 1 column;"super(MyGridLayout,self).__init__(**kwargs)
    self.cols = 1                                       # define standard grid with 1 column

    self.secondGrid = GridLayout()
    self.secondGrid.cols = 2                            # define second grid with 2 columns

    self.secondGrid.add_widget(Label(text=""Stock: ""))   # define content for the secondGrid
    self.stock = TextInput(multiline=False)
    self.secondGrid.add_widget(self.stock)
    self.add_widget (self.topGrid)

    self.submit = Button(text=""Levermann Score"", font_size =32)     # define button with only 1 column
    self.submit.bind(on_press=self.levermannCalc)
    self.add_widget(self.submit)";python
Set height and width of the widgets;"self.row_force_default=True     # necessary - otherwise no adjustment will be done for the widget
    self.row_default_height=120     # sets the height to 120 pixel

    # set height for the whole widgets in topGrid
    self.topGrid = GridLayout(
        row_force_default=True,
        row_default_height=40
    )

    # set width and heigth for individual widget
    self.top_grid.add_widget(Label(text=""Name: "",       # set the name of the widget
                                   size_hint_y=None,
                                   height=10,           # define height
                                   size_hint_x=None,
                                   width=200))          # define width";python
Seperate program in python from the gui-design (in a kv-file);"# python-file:
from kivy.uix.widget import Widget              # import widget module
from kivy.properties import ObjectProperty      # import object property
class MyGridLayout(Widget):
    inpfield = ObjectProperty(None)             # define an object and initialize empty
    def method_function(self):                  # defube a method / function in the the gui (eg. for a button)
        print(f""something"")
class MyApplication(App):                       # define the application class (kv-file must have the same name = MyApplication.kv)
    def build(self):
        return MyGridLayout()                   # name of the first line in the kv-file
if __name__ == ""__main__"":
    MyApplication().run()                       # run the gui

# kv-file (name must be in this case ""MyApplication.kv"")#
# intention is here very similar (only tabs - no spaces)
<MyGridLayout>
    inpfield : inpfield                         # initialize the input field

    GridLayout:                                 # define the main grid layout with one column
        cols: 1
        size: root.width, root.height           # take the root width/height (otherwise the objects will be placed in the very left bottom)
        row_force_default: True                 # necessary - otherwise no adjustment will be done for the widget
        row_default_height: 120                 # set the height (of the whole grid) to 120 pixel)

        GridLayout:                             # define second (nested) grid with two columns
            cols: 2
            row_force_default: True
            row_default_height: 40              # set the height (of every object in this grid to 40 pixel)

            Label:
                text: ""Stock Ticker""            # name of the label
            TextInput:
                id: inpfield                    # if of the inputfield
                text: blablabla                 # default value for the inputfield
                multiline: False                # no multiline input field

        Button:                                 # define button as part of the first gridlayout (so only 1 column)
        text: ""Button Text""                     # button text
        font_size: 32                           # font-size of the button text
        on_press: root.method_function()        # on button press call function ""method_function"" from the py-file
        size_hint_y: None
        height: 50                              # set height of the button to 50 pixel";python
Kivy Builder;"# link kv-files to python-file
from kivy.lang import Builder       # import builder module
Builder.load_file(""whatever.kv"")    # link the kv-file to the python-file (so the App-classname must not be the same as the kv-filename)";python
Coloring buttons and input fields;"# using rgb-color for the coloring
background_normal: ''                           # necessary to use this - otherwise the color will be mixed with the intial grey default
background_color: (1,0,0,1)                     # coloring the element in red
background_color: (238/255,250/255,0/255,1)     # using a rgb-color for the coloring

# using hexadecimal coloring
#:import utils kivy.utils                               # importing the kivy-utils in the very first line of the kv-file
background_color: utils.get_color_from_hex(""#eefa00"")   # coloring the element with this hex-code";python
Box Layout;"BoxLayout:
    orientation: ""horizontal""                   # arrange the object horizontal (also vertical possible)
    size: root.width, root.height               # use the full place of the window
    spacing: 20                                 # 20 pixels between the elements
    padding: 50                                 # 50 pixels padding around the elements

    Button:
    text: ""blablabla""                           # define button in the box-model
    size_hint: (0.5,0.5)                         # make the button the half-size (x- and y-axes) - working also responsive when the windows size is changed

    size_hint: (None, None)                     # set fixed size for the button (200 pixels width and 50 pixels height)
    width: 200
    height: 50
    pos_hint: {""center_x"": 0.5}                 # center the element horizontal";python
Inheritance, Widget Properties;"# Define the global settings in sepearte section in the kv-file
<Button>                            # these settings are used for all buttons in the window
    font_size: 32
    background_normal: ''
    background_color: (0,0,1,1)
<TextInput>                         # this color is used for all input fields in the window
    background_color: (150/255,150/255,150/255,1)

# But when some individual setting for an element is needed this is possible
<MyLayout>
    BoxLayout:
        TextInput:
            background_color: (1,0,0,1)     # background color for this input-field will be different then the global settings aboth";python
Color Labels;"# Works a little bit different that the normal coloring of objects like buttons or input fields
Label:
    background_color: (0,0,1,1)             # choose the color for the label
    canvas.before:                          # this whole code-part has to be added - otherwise there will be no label coloring
        Color:
            rgba: self.background_color
        Rectangle:
            size: self.size
            pos: self.pos

# Normal usage of other properties
    text: ""Name""                # name of the label
    font_size: 45               # font size of the label
    color: (0,1,0,1)            # color of the text of the label
    bold: True                  # text will be bold written
    italic: True                # text will be italic written
    outline_color: (0,0,0)      # set the color for the border of the text
    outline_width: 2            # width of the border of the text";python
Color Background;"# 1st method in kv-file: make a white background color
<MyLayout>
    canvas.before:
        Color:
            rgba: (1,1,1,1)
        Rectangle:
            pos: self.pos
            size: self.size

# 2nd method in py-file
from kivy.core.window import Window

class AwesomeApp(App):
    def build(self):
        Window.clearcolor = (1,1,1,1)
        return MyLayout()";python
Set window size;"# set windows size to width 550 and height 300
from kivy.core.window import Window
class MyLayout(Widget):
    Window.size = (550, 300)";python
DropDown box with spinner;"kv-file:
    Spinner:
        id: spinner_id
        text: ""Favorite""
        values: [""Pepperoni"",""Cheese"",""Mushroom"",""Pineapple""]
        on_text: root.spinner_clicked(spinner_id.text)

py-file:
    def spinner_clicked(self,value):
        self.ids.click_label.text = f""You selected: {value}""";python
Pygame documentation;http://pygame.org/docs/;python
Import of the pygame module;import pygame as pg;python
Initialize and setup screen;pg.init();python
Define dimension;screen_dim = (1200,800);python
Show screen with the defined dimensions;screen = pg.display.set_mode(screen_dim);python
Define background color;bg_color = (230,230,230);python
Screen filling with defined background color;screen.fill(bg_color);python
Title of the game in the window;"pg.display.set_caption(""My Super Game"")";python
Rectangle infos (left,top,width,height - (0,0,1200,800);rect screen.get_rect();python
Center of the Rectangle as tuple - (600,400);rect.center;python
Size of the Rectangle as tuple - (1200,800);rect-size;python
X-Dim left - (0);rect.left;python
X-Dim right - (1200);rect.right;python
Y-Dim top - (0);rect.top;python
Y-Dim bottom - (800);rect.bottom;python
Middle of X-Dim - (600);rect.centerx;python
Middle of Y-Dim - (400);rect.centery;python
Width of the rectangle - (1200);rect.width;python
Height of the rectangle - (800);rect.height;python
Define new rectangle;small_rect = pg.Rect(100,100,10,150);python
Draw small rectangle in screen;pg.draw.rect(screen,(100,100,100,small_rect);python
Loading an image;"figure = pg.image.load(""ship.png"")";python
Getting the rect object from an image;figure.get_rect();python
Positioning an image in the middle of the bottom screen;figure_rect.midbottom = screen_rect.midbottom;python
Drawing an image to the screen;screen.blit(figure, figure_rect);python
Check if an event has happend (keystroke, mouseclick);for event in pg.event.get():;python
Check if key is pressed;event.type == pg.KEYDOWN:;python
Some action when Right-Key is pressed;event.key == pg.K_RIGHT:;python
Some action when Space-Key is pressed;event.key == pg.K_SPACE:;python
Check if mousebutton is clicked;event.type == pg.MOUSEBUTTONDOWN;python
Findinig the mouse position;mouse_pos = pg.mouse.get_pos();python
Check if mouse-cursor is ofer an object / rectangle;button_rect.collidepoint(mouse_pos);python
Group class for working with similar objects;from pygame.sprite import Sprite,Group;python
Making and filling a group - must inherit from Sprite;def Bullet(Sprite):;python
Method from the new group;def draw_bullet(self):;python
Method from the new group;def update(self):;python
Define group of elements;bullet = Group();python
Define new instance;new_bullet = Bullet();python
Add new instance to group;bullets.add(new_bullet);python
Iterate through group instances and draw;from bullet in bullets.sprites(): bullet.draw_bullet();python
Calls the methode update() on each member of the group;bullets.update();python
Remove instance from group;bullets.remove(bullet);python
Check if single object is overlapping with groupelements;prg.sprite.spritecollideany(obj,group);python
Result-Dict with all overlapping elements of both groups;pg.sprite.groupcollide(group1,group2,True,True);python
Define message;"msg = ""Play again!""";python
Defines message color;msg_col = (100,100,100);python
Defines background color;bg_col = (230,230,230);python
Defines font from system font;font = pg.font.SysFont(None,48);python
Create an image of the message;msg_img = f.render(msg,True,msg_col,bg_col);python
Read rect from message-image;msg_img_rect = msg_image.get_rect();python
Pos the message-image in the middle of the window;msg_img_rect.center = screen_rect.center;python
Display the positioned message-image;screen.blit(msg_img, msg_img_rect);python
Import necessary modules;import pythoncom;python
Import client;import win32com.client;python
Import server;import win32com.server.register;python
Put everything in a class;class PythonObjectLibrary:;python
UniqueID for our object to register it with Windows;_reg_clsid_ = pythoncom.CreateGuid();python
Register the object as an EXE;_reg_clsctx = pythoncom.CLSCTX_LOCAL_SERVER;python
Register the object as a DLL;_reg_clsctx = pythoncom.IMPROC_SERVER;python
Name of the project library;"_reg_progid_ = ""Python.ObjectLibrary""";python
Optional / Description of the library;"_reg_desc_ = ""This is our Python Obj Library""";python
Name the functions - this sees the user in excel;"_public_methods_ = [""f1"",""f2,""f3""]";python
Define the function in the class;def f1(self, x, y):;python
Return the result of the function (to excel later);return x + y;python
Another function - this time wie a range (more cells in excel);def f2(self, myRange):;python
Create an instance of the range object passed trough;rng1 = win32com.client.Dispatch(myRange);python
Change the object to an numpy-array (or an list);rng1val = np.array(list(rng1.Value));python
Return the sum of the range (to excel later);return rng1val.sum();python
Part of the code in the main-section;"if __name__ == ""__main__"":";python
Register the library (when the program is started => the Library is registered in Windows);win32com.server.register.UseCommandLine(PythonObjectLibrary);python
Part in Excel;"(in the Visual Basic Editor under Development Tools)
# Definition of the f1-function - now the user can use the function ""f1"" in excel
Function f1(x As Long, y As Long)
    f1 = VBA.CreateObject(""Python.ObjectLibrary"").f1(x, y)
End Function
# Definition of the f2-function - now the user can use the function ""f2"" in excel
Function f2(x As Range)
    f2 = VBA.CreateObject(""Python.ObjectLibrary"").f2(x)
End Function";python
create basic api in flask;https://nordicapis.com/how-to-create-an-api-from-a-dataset-using-python-and-flask/;python
create basic api in flask, deploy to AWS with zappa and setup on Rapidapi;https://pythonforundergradengineers.com/deploy-serverless-web-app-aws-lambda-zappa.html#what-is-zappa;python
create basic api in flask, deploy to AWS with zappa and;https://towardsdatascience.com/develop-and-sell-a-python-api-from-start-to-end-tutorial-9a038e433966;python
Import the module;import flask;python
Creates a Flask application;app = flask.Flask(__name__);python
Runs the program in debug mode (no reset necessary when changing a line of code);"app.config[""DEBUG""] = True";python
"""/"" indicates where the result in the url will output - GET will read data (POST for writing data)";@app.route('/', methods=['GET']);python
Runs the application;app.run();python
Outputs a List with a dict to the server / url;"@app.route('/api/v1/resources/books/all', methods=['GET'])	# Data will available at: http://127.0.0.1:5000/api/v1/resources/books/all
def api_all():
    return jsonify(books)	    # Converts and returns the list in JSON-Flask-format
app.run()
# results are available under http://127.0.0.1:5000/api/v1/resources/books/all";python
Filtering data;"@app.route('/api/v1/resources/books', methods=['GET'])
def api_id():
    if 'id' in request.args:					# Check if an ID was provided as part of the URL
        id = int(request.args['id'])			# If ID is provided, assign it to a variable
    else: return ""Error: No id field provided""	# If no ID is provided, display an error in the browser.
    for book in books:							# Loop through the data and match results that fit the requested ID
        if book['id'] == id: results.append(book)
    return jsonify(results)						# Use the jsonify function from Flask to convert our list of - Python dictionaries to the JSON format
app.run()
# results are available under http://127.0.0.1:5000/api/v1/resources/books?id=1";python
Check if API is called from the right access-place (like rapidapi.com);"(key is provided from the platform - eg. here from rapidapi.com)
    if ""e6e45ed0-55e5-11eb-963e-ffe9fcdce080"" not in request.headers:
        return ""Error: Wrong API-Call - use www.rapidapi.com for calling the API!""";python
Using zappa and deploying to AWS (zappa is only working in a virtual environment);"pip install zappa											=> Install module
=> Create file and insert the credentials from AWS (creation see second link above)
create file credentials in ""%UserProfile%\.aws
	[default]
	aws_access_key_id = XXXXXXXXXXXXXXXXXXXXXXXXXX
	aws_secret_access_key = XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
virtualenv xyz									# Create an virtual environment
xyz\Scripts\activate							# Activate virtual environment
go back to folder xyz and install all necessary modules with pip install
pip list										# Check if everything is installed in the folder
zappa init (when virutal environement is activated!)		# Create zappa_settings.json File (press return at any prompt)
    ""dev"": {
		""app_function"": ""app.app"",				# Name of the py-file
		""aws_region"": ""eu-central-1"",			# Nearest aws-region
        ""profile_name"": ""default"",				# Same as in aws-credentials at ""%UserProfile%/.aws/credentials
        ""project_name"": ""apicheck"",
        ""runtime"": ""python3.7"",					# Automatic generated
        ""s3_bucket"": ""zappa-gsoln7zyl""			# Automatic generated
    }
pip freeze > requirements.txt					# Create requirements.txt for all installed modules in the virtual environment
zappa deploy dev (when virutal environement is activated!)	# Deploy everything to AWS (when ended with link everything worked fine) (otherwise 502 error - often a module is missing)
	eg. https://xnujiyxsb1.execute-api.eu-central-1.amazonaws.com/dev/api/v1/incstat?ticker=FB
		https://xnujiyxsb1.execute-api.eu-central-1.amazonaws.com/dev/api/v1/summary?ticker=CAT
		https://xnujiyxsb1.execute-api.eu-central-1.amazonaws.com/dev/api/v1/profile?ticker=FB
zappa update dev (when virutal environement is activated! and actual directory is correct where the py-file is!)	# Update deployment on AWS (when something changed in the pyhton-program)
zappa status									# Show actual status
zappa tail										# Show actual loggin (in error cases)
zappa undeploy dev								# Undeploy everything on AWS";python
AWS part;"see the APIs under AWS Api Geteway => region on the upper right site has to be the same as in the zappa_settings.json file#
check API-access
	select API (under API Gateway and APIs)
	click on second ANY link
	click Test (on the left side)
	select Method Get
	input path example under {proxy} eg. api/v1/incstat?ticker=FB
	click Test Button (at the bottom)";python
https://stackabuse.com/deploying-a-flask-application-to-heroku/;"git init (when .git is not in the folder of the api)
git add .
git commit -m ""upd""
heroku login -i
heroku git:remote -a financerapidapi (name of the app on heroku)
git push heroku main";python
import module;from fastapi import FastAPI;python
start reloading app (refreshed automatically);uvicorn main:app --reload;python
for rendering the html-page;jinja2 templates;python
framework for formatting (like bootstrap);semantic-ui.com;python
for html-templates which can be used in several other html-files;layouts.html;python
for interactive candlebars on the webpage;javascript-code;python
simplest route;"app = FastAPI()
@app.get(""/"")
def index():
  return {""message"": ""hello world!""}";python
Imort icecream;from icecream import ic;python
Show value of the variable in the form: ic| var1: 20;ic(var1);python
Show when command is reached: ic| icecream_example.py:5 in func() at 01:44:20.394 (line / file / time);ic();python
Set Context Output => also shows line / file / time;ic.configureOutput(includeContext=True);python
Installation;"Download whl file from here: https://www.lfd.uci.edu/~gohlke/pythonlibs/#ta-lib
(with corresponding python version (eg. cp39) and os (eg. adm64)
then: pip install *.whl (eg. pip install TA_Lib-0.4.19-cp39-cp39-win_amd64.whl)
then: pip install TA-Lib";python
Installation (yfinance as yf not working - problems with pyinstaller);import yfinance;python
Read data for ticker yahoo finance ticker symbol;dataYF = yf.Ticker(ticker);python
Summary info for stock / cryptopcoin;dataYF.info;python
Price data as dataframe from/to-date;"yf.download(ticker,""2020-01-01"",""2021-03-31))";python
Intraday price data as dataframe for 1 month and 60 minute interval;"dataYF.history(period=""1mo"",interval=""60m"")";python
Intraday price data as dataframe for 1 day and 2 minute interval;"dataYF.history(period=""1d"",interval=""2m"")";python
Financial data;dataYF.financials;python
Dividends (date and amount);dataYF.dividends;python
Splits (date and split-factor);dataYF.splits;python
Percent major holders;dataYF.major_holders;python
Biggest Insitutional holders;dataYF.institutional_holders;python
Balance Sheet Data;dataYF.balance_sheet;python
Cashflow Data;dataYF.cashflow;python
Earnings Data (Revenue, Income);dataYF.earnings;python
Sustainability Informations (palm oile, military, adult, etc.);dataYF.sustainability;python
Recommendations from different agencies;dataYF.recommendations;python
Calendar data;dataYF.calendar;python
ISIN-Number;dataYF.isin;python
installation;pip install plotly;python
examples of graphing libraries;https://plotly.com/python/;python
see example for candlestick-chart;Python-Diverses / Plotly / example.py;python
Video Training;https://www.youtube.com/watch?v=F5mRW0jo-U4&t=5043s;python
Example;C:\Users\Polzi\Documents\DEV\Python-Diverses\Django;python
installation;pip install django;python
create a blank django project;django-admin startproject pjName;python
run django server (start site on http://127.0.0.1:8000/);python manage.py runserver;python
python manage.py runserver        run django server (start site on http://127.0.0.1:8000/);"BASE_DIR => directory of the django-project
  SECRET_KEY => individual key from django-project
  DEBUG => should be set to False in production
  INSTALLED_APPS => componente / pieces of the django-project
  DATABASES => database of the django-project";python
DATABASES database of the django-project;"# create a new app / component
  models.py => create models and link to the database
  add ""products"" to INSTALLED_APPS in settings.py";python
create superuser (eg. for login to /admin app/component);python manage.py createsuperuser;python
prepeare migrations (when anything changed in the apps);python manage.py makemigrations;python
migrate all changes;python manage.py migrate;python
now products can created in the /admin-page;add this: from .models import Product in admin.py of the products app / component;python
open django-sheel (eg. create products from the shell );python manage.py shell;python
overview builtins;https://docs.djangoproject.com/en/4.0/ref/templates/builtins/;python
include html in an html-page (navbar.html);"{% include ""navbar.html"" %}";python
extend html-page (base.html);"{% extends ""base.html""  %}";python
replace this block content;{% block content %} xyz {% endblock %};python
add 2 to the value;"{{ x|add:""2"" }}";python
if statement;{{ if x in lst }};python
elif statement;{{ elif x == 3 }};python
else statement;{{ else }};python
close if statement;{{ end if }};python
capitalize first letter;{{ x|capfirst }};python
uppercase whole string;{{ x|upper }};python
capitalize and upper the whole string;{{ x|capfirst|upper }};python
add a new module / component;"- python manage.py startapp products    # create ""products"" folder
- create class in models.py of the products-folder
- import and register at admin-site in admin.py of the products-folder
- add products to INSTALLED_APPs in settings.py of the project-folder";python
add a new website;"# create ""pages"" folder
  - python manage.py startapp pages
# eg. function with HttpResponse to output html-code
# for that function import is necessary with ""from django.http import HttpResponse""
  - add view in views.py of the pages-folder
- add pages to INSTALLED_APPS in settings.py of the project-folder
# import view with ""from pages.views import homeView""
# set path with eg. ""path('', homeView, name=""home"")""
  - add pages/view in urls.py fo the project-folder";python
request and show page/view;"# in urls.py the requests are stored
  eg. path('contact/', contactView)
# and in the views.py is the html-code stored
  eg. def contactView(*args, **kwargs):
        return HttpResponse(""<h1>Contacts!</h1>"")";python
using templates;"# render the page in views.py
  eg. def contactView(request, *args, **kwargs):
        return render(request, ""contact.html"", {})
# create a folder eg. ""templates"" and put all html-pages in it
  eg. about.html, contact.html, home.html
# change DIRS in TEMPLATES in settings.py
  eg. to 'DIRS': [os.path.join(BASE_DIR, ""templates"")],";python
extends: template Inheritance;"# create base-html
  eg. <h1>This is a navbar</h1>
      {% block content %}
        replace me
      {% endblock %}
# inside the about-html
  eg. {% extends ""base.html""  %}
      {% block content %}
        <h1>About</h1>
        <p>This is a template</p>
      {% endblock %}
# ""replace me"" will get replace by the info from about-html from the block content";python
include: something in html;"{% include ""navbar.html"" %}";python
render data in html;"# render html-page with dictionary
  define myContext as Dictionary
  myContext = {
    ""myText"": ""This is about me"",
    ""myNumber"": 123,
    ""myList"": [123, 4242, 12313]
  }
  eg. return render(request, ""about.html"", myContext)
# access this dict in the html-page
  eg. {{ myText }}, {{ myNumber }}";python
for loop when rendering;"# get myList from Dictionary in views.py
  {% for mySubItem in myList %}
    <li>{{ forloop.counter }} - {{ mySubItem }}</li>
  {% endfor %}";python
Config Mail;dolt config --global --add user.email YOU@DOMAIN.COM;python
Config Name;"dolt config --global --add user.name ""YOUR NAME""";python
Login and the key;dolt login;python
Clone DB-Repos;dolt clone dolthub/baseball-databank;python
Show tables in db;dolt ls;python
Read column description for table;"dolt sql -q ""describe Salaries""";python
Run some query on the table;"dolt sql -q ""SELECT * FROM Salaries""";python
Write query to table;"dolt sql -r csv -q ""SELECT * FROM Salaries"" > salary-hr.csv";python
install python modules in specific version / environment;pip3.7 install --user --upgrade selenium;python
New => Create new app => give name with only lowercases;on Heroku: create App;python
Setting => Add buildpack => choose python;on Heroku: set python build path;python
Create Procfile with 2 lines => web: python appname.py, worker: python appname.py;in App-folder: create Procfile;python
Create or Copy the requirements.txt => eg. pip freeze> requirements.txt;in App-folder: create requirements.txt;python
when there is not git-structure yet;in App-folder: git init;python
like xlwings, openpyxl, pywin32;delete not possible modules	in cloud;python
login to heroku (login page opens in the browser);heroku login;python
connect to the heroku app;heroku git:remote -a HEROKU_APP_NAME;python
add files (like in git);git add .;python
commit files (like in git;"git commit -am ""msg""";python
push the files to heroku for build (try master instead of main when not working);git push heroku main;python
in Resources deselect both (otherwise the program will run more times per day);on Heroku: deselect web + worker;python
Heroku Scheduler for scheduling the app, Papertrail for logs;on Heroku: add Add-ons;python
Schedule the app run times;on Heroku / Scheduler;python
Show which dynos are running currently;heroku ps -a appName;python
run the app / script which is hosted on heroku (only possible when no dyno is running);heroku run -a <appName> python <prg.py>;python
see all running dynos;heroku ps -a <appName>;python
"stop the running dyno with name ""scheduler.6436""";heroku ps:stop scheduler.6436 -a <appN>;python
using TA-Lib on heroku;"remove TA-Lib from requirtements.text
Described here: https://stackoverflow.com/questions/43453953/how-to-install-python-library-in-heroku
GitDoku: https://github.com/numrut/heroku-buildpack-python-talib
use this commands instead:
heroku buildpacks:add --index 1 heroku/python
heroku buildpacks:add --index 2 numrut/ta-lib
schedule the running time with addon Heroku Scheduler";python