Thanks to antville.org
Sunday, 16. December 2018
Infer types in pandas

This will return the mixed datatypes but this can be slow.

df.applymap(type).nunique() > 1

Better approach pythonic approach would be...

from pandas.api.types import infer_dtype

infer_dtype(df.A)
'mixed-integer'

df.apply(lambda x: 'mixed' in infer_dtype(x))

... Link (0 comments) ... Comment


Sunday, 4. November 2018
Extract words from Marathi wikipedia

1) Download the polyglot pickled marathi model
wget bit.ly
mv 12FI1xV polyglot-mt.pkl

2) Extract all the words from the embedding

from polyglot.mapping import Embedding
embeddings=Embedding.load("polyglot-mt.pkl")
with open('myfile.txt', 'w') as fx:
for i in embeddings.vocabulary:
fx.write(i.encode('utf-8')+'\n')

3) Download the wordlist:
s3.amazonaws.com

... Link (0 comments) ... Comment


Monday, 10. September 2018
Google Input tools

Google suddenly stopped download of Input Tools package without giving any reason. And here is official response by Google:
We have been in touch with the Google Input Tools team and have confirmed that the Windows application is no longer available for download or installation. Instead, the team recommends you install the Google Input Tools Chrome extension as an alternative.

This is not expected from a company like google.

... Link (0 comments) ... Comment


Saturday, 18. August 2018
Python objects and methods

Here are important python objects and their methods
int mul, add, eq, ge, mod, pow
float .isinteger()
string .upper(), .endswith(), .split()
bool .numerator .abs()
list .append, .pop, _len
() / slicing
tuple
dict .items(), .keys(), .values() / slicing
pd.Series .sum(), .stack(), .groupby(), .resample(), .sort_values(), .sort_index(), .iloc
pd.DataFrame

... Link (0 comments) ... Comment


Wednesday, 8. August 2018
JSON to DF

Here is how to read a JSON file into pandas dataframe.

import json
import pandas as pd

with open('/tmp/aclImdb/movie_data/gv.json', 'r') as f:
data = json.load(f)

df=pd.DataFrame(data['data'])
df.to_excel('gov.xlsx')

... Link (0 comments) ... Comment


Saturday, 4. August 2018
managing servers using python

Fabric is a high level Python library designed to execute shell commands remotely over SSH, yielding useful Python objects in return:
"""
a#!/usr/bin/env python
from fabric.api import hosts, run, task
from fabric.tasks import execute

@task
@hosts(['shantanu@1.2.3.4:1224'])
def test():
run('hostname -f')

if name == 'main':
execute(test)
"""

... Link (0 comments) ... Comment


Sunday, 20. May 2018
backup mysql users

It is easy to backup mysql users -

wget percona.com/get/pt-show-grants;
perl pt-show-grants

... Link (0 comments) ... Comment


About python

1 everything is an object (class instances)
2 methods depends upon class of the instance
3 int,str and tuple are immutability, dict and list are mutable
4 dict keys are unique but series allows duplicate
5 list comprehension
6 slice of dict, str, list
7 dynamically typed
8 iterables are str, list, dict but int are not
9 functions are first class objects and can be applied just like built-in classes

... Link (0 comments) ... Comment


Wednesday, 16. May 2018
mysql and shell command

date -d"-1 day ago" +'%b%d'

equals to

mysql -Bse"select date_format(date(date_add(now() , interval 1 day)),'%b%d')"

... Link (0 comments) ... Comment


Saturday, 12. May 2018
Preserving comments in Stored Procedure

You can write multi line comments in a stored procedure by following mysql to think that it is a version specific code.

/!9999
Multi line comment, retained by mysql
not executed till it reaches the mysql version 9999 :))
/

... Link (0 comments) ... Comment


Online for 6205 days
Last modified: 8/7/19 10:49 AM
Status
Youre not logged in ... Login
Menu
... Home
... Tags

Search
Calendar
August 2019
SunMonTueWedThuFriSat
123
45678910
11121314151617
18192021222324
25262728293031
June
Recent updates
Remove old backup files Cron
entry to remove all files in /home/ folder that starts...
by shantanuo (8/7/19 10:49 AM)
Types in AWS CNF List
of important Types in Amazon Cloud Formation tool: IAM (User,...
by shantanuo (8/5/19 7:36 AM)
codes used for classification Standard
codes used for classification: 1 SC 2 OBC 3 SBC...
by shantanuo (6/25/19 11:11 AM)
Shell scripting basics Here are
8 important concepts of Shell scripting that everyone should know....
by shantanuo (6/2/19 6:50 AM)
schema conversion tool This seems
to be a useful tool to convert mysql or oracle...
by shantanuo (3/30/19 6:52 AM)
Install packetbeat In order to
install packetbeat, you may need to change the windows security...
by shantanuo (3/26/19 8:01 AM)
python itertools module from itertools
import groupby s = 'abcccccbba' for w, v in groupby(s):...
by shantanuo (3/17/19 3:22 PM)
audio visual modules for Machine
Learning Here is the list of some of the modules...
by shantanuo (3/16/19 1:08 PM)
google module module for google
search !pip install google from googlesearch import search for url...
by shantanuo (1/8/19 10:38 AM)
Python date and time from
datetime import datetime date_string = "21 June, 2018" date_object =...
by shantanuo (12/26/18 12:14 PM)
Infer types in pandas This
will return the mixed datatypes but this can be slow....
by shantanuo (12/16/18 3:50 PM)
Extract words from Marathi wikipedia
1) Download the polyglot pickled marathi model wget http://bit.ly/12FI1xV mv...
by shantanuo (11/4/18 10:06 AM)
Google Input tools Google suddenly
stopped download of Input Tools package without giving any reason....
by shantanuo (9/10/18 7:44 AM)
Python objects and methods Here
are important python objects and their methods int __mul__, __add__,...
by shantanuo (8/18/18 3:11 PM)
JSON to DF Here is
how to read a JSON file into pandas dataframe. import...
by shantanuo (8/8/18 1:12 PM)
managing servers using python Fabric
is a high level Python library designed to execute shell...
by shantanuo (8/4/18 10:01 AM)
backup mysql users It is
easy to backup mysql users - wget percona.com/get/pt-show-grants; perl pt-show-grants
by shantanuo (5/20/18 3:42 PM)
About python 1 everything is
an object (class instances) 2 methods depends upon class of...
by shantanuo (5/20/18 2:52 PM)
mysql and shell command date
-d"-1 day ago" +'%b%d' equals to mysql -Bse"select date_format(date(date_add(now() ,...
by shantanuo (5/16/18 7:47 AM)
Preserving comments in Stored Procedure
You can write multi line comments in a stored procedure...
by shantanuo (5/12/18 12:56 PM)
Custom slack command Here are
5 steps to add any API to your slack channel....
by shantanuo (4/25/18 6:59 AM)
stack bookmarklet This bookmarklet will
help to quickly access stack pages linking to current page...
by shantanuo (1/10/18 10:47 AM)
Manage S3 like rsync ####
create bucket aws s3 mb s3://johntest123/ #### rsync all files...
by shantanuo (12/22/17 12:04 PM)
apache docker container issues If
apache docker container does not start then make these changes......
by shantanuo (11/10/17 3:00 PM)
Install aws client on centos
If pip is not installed, then the following command will...
by shantanuo (10/26/17 9:51 AM)

RSS feed

Made with Antville
Helma Object Publisher