Thanks to antville.org

python module itertools

shantanuo — Wed, 08 Sep 2021 07:50:09 GMT

list of useful methods of itertools module.

permutationscombinationscombinations_with_replacementzip_longestcountrepeatcycleaccumulateproductgroupbyteeisslicechainchain.from_iterablefilterfalsedropwhile

realpython.com

program creek

shantanuo — Sat, 11 Apr 2020 11:24:15 GMT

program creek seems to be a good site for handy references of python modules. For e.g. when I wanted to know how to use Stratified Shuffle module, the examples shown on this page were very useful.

www.programcreek.com

Standard out to a file

shantanuo — Sat, 11 Apr 2020 11:18:11 GMT

This code will change the standard out to a file so that jupyter notebook cell's responses are saved to a file.

import sysoldStdout = sys.stdoutfile = open('logFile', 'w')sys.stdout = file

ipython parallel demo

shantanuo — Sun, 09 Feb 2020 09:02:12 GMT

First start ipython in cluster mode

ipcluster start -n 4

from IPython.parallel import Clientrc = Client()v=rc.load_balanced_view()@v.parallel(block=True)def f(x): return 2*xresult = f.map(range(10))print("Using a parallel function: ", result)

djanog settings

shantanuo — Sun, 09 Feb 2020 04:07:00 GMT

You may see this message if you have DEBUG = True in your Django settings file and you haven't configured any URLs.

django-admin.py startproject todo

python manage.py runserver localhost:8000

$$ If you plan to use a database, edit the DATABASES setting in todo/settings.py.python manage.py startapp todoapp

$$ syncdb and flush are other 2 parameters accepted by manage.py

14 days ago

shantanuo — Tue, 14 Jan 2020 14:26:42 GMT

This is the python way of calculating the date that is 14 days ago.

import datetime(datetime.datetime.now() - datetime.timedelta(days = 14)).date()

And this is pandas way of getting the same results:

import pandas as pd(pd.datetime.today() - pd.offsets.Day(14)).floor('D')

Install java within conda container

shantanuo — Fri, 20 Sep 2019 10:40:21 GMT

apt-get update && apt-get upgrade
mkdir -p /usr/share/man/man1apt-get install default-jdkapt install openjdk-11-jdk

python itertools module

shantanuo — Sun, 17 Mar 2019 13:22:26 GMT

from itertools import groupbys = 'abcccccbba'

for w, v in groupby(s):print (''.join(w), ''.join(v))

a ab bc cccccb bba a

google module

shantanuo — Tue, 08 Jan 2019 08:38:49 GMT

module for google search

!pip install google

from googlesearch import searchfor url in search('"Breaking Code" WordPress blog', stop=10):print(url)

Extract words from Marathi wikipedia

shantanuo — Sun, 04 Nov 2018 08:06:09 GMT

Download the polyglot pickled marathi modelwget bit.lymv 12FI1xV polyglot-mt.pkl
Extract all the words from the embedding

from polyglot.mapping import Embeddingembeddings=Embedding.load("polyglot-mt.pkl")with open('myfile.txt', 'w') as fx:for i in embeddings.vocabulary:fx.write(i.encode('utf-8')+'\n')

Download the wordlist:s3.amazonaws.com