A Beginner’s Guide to Topic Modeling in Python

Since the launch of its public beta in 2008, Glassdoor has become the gold standard for company satisfaction ratings. They also have a classifieds section comparable to LinkedIn, Indeed, and others.

Glassdoor provides examples of job descriptions with company ratings in context. This makes it easy to compare what good and bad companies have in common when it comes to word usage.

Gathering the data

First, I downloaded more than 8,000 job postings from some of America’s most common jobs:

Retail Salesperson, Cashier, Office Clerk, Registered Nurse, Waiter, Customer Service, Janitor, Counter Attendant, Material Mover, Stock Clerk, Secretary, Bookkeeping Clerk, Accounting Clerk, Auditing Clerk, General Manager, Truck Driver, Elementary School Teacher

I formatted each listing like this:

JSON data file example

Next, I grouped all listings into one job_descriptions.txt file, for training a word segmentation model. I lower-cased the descriptions to boost performance.

Using code from Word Segmentation in Python, we can split the job postings into a collection of subwords:

if not os.path.isfile('{0}.model'.format(model_path)):
    spm.SentencePieceTrainer.Train('--input=job_descriptions.txt --model_prefix=job_descriptions --vocab_size=6000 --split_by_whitespace=False')
sp = spm.SentencePieceProcessor()
sp.load('job_descriptions.model'.format(model_path))
# To tokenize, use: sp.EncodeAsPieces(job_description)

Looking at the data

The top 25% of posts are from companies with 3.8⭐ or more. The bottom 25% are from companies with 3.1⭐ or less.

Glassdoor ratings, bottom and top quartiles colored.

Next, I used the word segmentation model to create a frequency-normalized bag of words model. Then I compared the word frequencies of well-rated companies to poorly-rated companies.

Phrases to use

The following words were used at least 10 times in both good and bad listings, and occur at least 2x more frequently in good listings as bad listings:

Phrase Frequency
▁cdl▁driver 21.7x more frequent
▁prepare▁food 17.6x more frequent
other▁duties 16.5x more frequent
▁or▁part▁time 15.9x more frequent
a▁neat▁and▁clean 15.4x more frequent
▁primary▁purpose 12.8x more frequent
▁outside▁of▁the 11.6x more frequent
▁ascend 10.6x more frequent
▁class▁b 10.2x more frequent
▁job▁posting 9.8x more frequent
▁ensure▁quality 9.5x more frequent
▁number▁of▁hours 9.1x more frequent
▁and▁reaching 9.1x more frequent
paid▁life 8.9x more frequent
cdl▁truck▁driver 8.7x more frequent
graduate▁of▁an▁a 8.4x more frequent
▁ambassador 8.4x more frequent
▁proud▁to▁offer 8.3x more frequent
▁assistance▁or▁a 8.2x more frequent
▁weekly▁pay 8.1x more frequent
▁icu 8.1x more frequent
ccredited▁school 7.9x more frequent
▁trustworthy 7.7x more frequent
▁providing▁an 7.6x more frequent
▁by▁applying 7.6x more frequent
lick 7.6x more frequent
a▁driver 7.6x more frequent
▁and▁alcohol 7.4x more frequent
n▁equal▁opport 7.2x more frequent
▁serve▁as▁a 7.1x more frequent
▁plus▁benefits 6.8x more frequent
▁privacy▁policy 6.7x more frequent
▁which▁we 6.6x more frequent
▁nursing▁process 6.6x more frequent
▁full▁time▁shift 6.4x more frequent
▁beverage▁items 6.3x more frequent
raising 6.1x more frequent
▁connect▁with▁us 5.8x more frequent
▁and▁total 5.8x more frequent
▁pattern 5.8x more frequent
▁and▁see▁wh 5.7x more frequent
▁which▁c 5.7x more frequent
▁customer▁focus 5.6x more frequent
▁verbally 5.5x more frequent
5.5x more frequent
▁also▁includes 5.5x more frequent
▁vital▁signs 5.5x more frequent
▁no▁mo 5.4x more frequent
▁surgical 5.3x more frequent
▁by▁greeting 5.3x more frequent
▁time▁off 5.2x more frequent
▁shelving 5.2x more frequent
▁class▁a▁cdl 5.1x more frequent
▁highly▁desired 5.1x more frequent
▁$8 5.1x more frequent
after 5x more frequent
▁hours▁worked 5x more frequent
▁our▁drivers 4.9x more frequent
▁profitable 4.9x more frequent
▁our▁goal▁is▁to 4.9x more frequent
▁any▁of▁the 4.9x more frequent
▁rewards▁program 4.9x more frequent
ounds 4.9x more frequent
▁ess 4.8x more frequent
▁weeks▁of 4.8x more frequent
▁difficult 4.8x more frequent
▁friendly▁manner 4.8x more frequent
▁there▁may▁be▁a 4.7x more frequent
ontinues▁to▁grow 4.6x more frequent
▁strong▁comm 4.6x more frequent
▁criminal▁histor 4.6x more frequent
▁bls 4.6x more frequent
▁starting▁pay 4.5x more frequent
actice 4.5x more frequent
▁you▁have▁the 4.4x more frequent
first 4.4x more frequent
▁dining▁areas 4.4x more frequent
▁acute 4.4x more frequent
▁profit▁sharing 4.4x more frequent
▁therapeutic 4.3x more frequent
:▁$10.00 4.3x more frequent
▁tractor▁trailer 4.3x more frequent
▁consulting 4.3x more frequent
continu 4.3x more frequent
▁any▁other▁job 4.3x more frequent
▁pediatric 4.2x more frequent
▁glassdoor 4.1x more frequent
▁territory 4.1x more frequent
▁spiritual 4.1x more frequent
▁southwest 4.1x more frequent
▁real▁estate 4.1x more frequent
▁unlawful 4x more frequent
▁dependent▁care 3.9x more frequent
▁residency 3.9x more frequent
recommended 3.9x more frequent
▁who▁require 3.8x more frequent
safety▁standards 3.8x more frequent
▁consultant 3.7x more frequent
sponsored 3.7x more frequent
▁applicants▁with 3.7x more frequent
paid▁weekly 3.7x more frequent
▁on▁facebook 3.7x more frequent
▁in▁the▁store 3.7x more frequent
▁convenience 3.6x more frequent
▁points 3.6x more frequent
▁cdl 3.6x more frequent
▁and▁have▁a 3.6x more frequent
▁hotel▁room 3.6x more frequent
▁cancer 3.5x more frequent
▁radius 3.5x more frequent
▁expansion 3.5x more frequent
▁a▁commitment▁to 3.5x more frequent
▁tobacco 3.5x more frequent
▁and▁replenish 3.5x more frequent
▁degree▁from▁a 3.4x more frequent
▁voluntary 3.4x more frequent
▁specialties 3.4x more frequent
▁days▁of▁hire 3.4x more frequent
▁2017 3.4x more frequent
▁seattle 3.3x more frequent
▁automation 3.3x more frequent
▁of▁patients 3.3x more frequent
▁university 3.3x more frequent
▁confident 3.3x more frequent
▁assignment 3.3x more frequent
▁in▁employment▁i 3.3x more frequent
▁genuine 3.3x more frequent
▁professionally 3.2x more frequent
▁per▁diem 3.2x more frequent
▁star 3.2x more frequent
▁or▁call 3.2x more frequent
▁a▁variety▁of▁b 3.2x more frequent
▁proposal 3.1x more frequent
▁william 3.1x more frequent
one▁to▁two▁years 3.1x more frequent
▁announce 3.1x more frequent
▁minnesota 3x more frequent
▁direct▁deposit 3x more frequent
▁fees 3x more frequent
▁acls 3x more frequent
▁southern 3x more frequent
▁asset 3x more frequent
▁staffing 3x more frequent
66 3x more frequent
▁respectful 3x more frequent
▁their▁lives 3x more frequent
▁texas 3x more frequent
▁$6 2.9x more frequent
▁all▁aspects▁of 2.9x more frequent
american▁h 2.9x more frequent
eart▁association 2.9x more frequent
▁affairs 2.9x more frequent
▁involved▁in 2.9x more frequent
ealthcare 2.9x more frequent
▁considered 2.9x more frequent
ble 2.9x more frequent
▁oncology 2.9x more frequent
▁charlotte 2.8x more frequent
▁prescription 2.8x more frequent
▁favorite 2.8x more frequent
▁keywords 2.8x more frequent
▁military 2.8x more frequent
rough 2.8x more frequent
▁phoenix 2.8x more frequent
▁directing 2.8x more frequent
▁grant 2.8x more frequent
▁2018 2.8x more frequent
decide 2.8x more frequent
medical▁surgical 2.8x more frequent
▁monetary 2.8x more frequent
strong 2.8x more frequent
▁therapies 2.8x more frequent
▁let 2.8x more frequent
▁foodservice 2.8x more frequent
▁per▁year 2.8x more frequent
▁our▁client 2.8x more frequent
▁experiencing 2.8x more frequent
▁5:00 2.8x more frequent
▁rd 2.8x more frequent
▁analyst 2.8x more frequent
▁substitute 2.7x more frequent
▁we▁look▁for 2.7x more frequent
▁pay▁rate 2.7x more frequent
wellness▁program 2.7x more frequent
▁operation▁of▁a 2.7x more frequent
▁5:30 2.7x more frequent
▁cloud 2.7x more frequent
▁of▁nursing 2.7x more frequent
▁offens 2.7x more frequent
▁reputation 2.7x more frequent
having 2.7x more frequent
▁permanent 2.7x more frequent
▁beach 2.7x more frequent
▁examination 2.7x more frequent
▁an▁exceptional 2.6x more frequent
negotiable 2.6x more frequent
▁creation 2.6x more frequent
▁rapid 2.6x more frequent
▁intelligence 2.6x more frequent
▁fix 2.6x more frequent
,500 2.6x more frequent
enefits 2.6x more frequent
▁construction 2.6x more frequent
▁payable 2.6x more frequent
▁carries 2.6x more frequent
▁without▁regard 2.6x more frequent
▁rating 2.6x more frequent
▁and▁ensuring▁th 2.5x more frequent
▁necessity 2.5x more frequent
▁fortune 2.5x more frequent
▁recent 2.5x more frequent
▁specializes 2.5x more frequent
2.5x more frequent
▁entrepreneurial 2.5x more frequent
ese 2.5x more frequent
▁engineering 2.5x more frequent
▁connection 2.5x more frequent
▁school▁year 2.5x more frequent
▁acquisition 2.5x more frequent
▁annually 2.5x more frequent
▁participation 2.5x more frequent
▁submitted 2.5x more frequent
▁advertising 2.5x more frequent
▁we▁are▁proud 2.5x more frequent
▁precise 2.5x more frequent
▁nursing▁care 2.5x more frequent
▁running 2.5x more frequent
no▁touch▁freight 2.4x more frequent
▁sector 2.4x more frequent
▁ethical 2.4x more frequent
▁equity 2.4x more frequent
▁sharing 2.4x more frequent
▁accident 2.4x more frequent
commuter▁benefit 2.4x more frequent
n▁accredited 2.4x more frequent
staff▁accountant 2.4x more frequent
▁eligibility 2.4x more frequent
▁campaign 2.4x more frequent
owned 2.4x more frequent
▁rn▁license 2.4x more frequent
▁psychosocial 2.4x more frequent
▁someone▁who▁is 2.4x more frequent
▁fluid 2.4x more frequent
▁our▁clients 2.4x more frequent
training▁program 2.4x more frequent
▁controller 2.4x more frequent
▁military▁status 2.4x more frequent
▁progressive 2.4x more frequent
▁focuses▁on 2.3x more frequent
▁your▁experience 2.3x more frequent
transition 2.3x more frequent
▁fixed▁asset 2.3x more frequent
▁we▁value 2.3x more frequent
▁yes 2.3x more frequent
▁reliable 2.3x more frequent
▁and▁develop 2.3x more frequent
functional 2.3x more frequent
▁firm 2.3x more frequent
▁apprais 2.3x more frequent
brook 2.3x more frequent
▁a▁company▁that 2.3x more frequent
▁pressure 2.3x more frequent
▁nurture 2.3x more frequent
▁if▁you▁have 2.3x more frequent
week 2.3x more frequent
▁in▁the▁past 2.3x more frequent
▁enthusiasm 2.3x more frequent
▁gym 2.3x more frequent
▁serious 2.3x more frequent
▁personal▁growth 2.3x more frequent
▁benchmark 2.3x more frequent
▁capital 2.3x more frequent
▁juni 2.3x more frequent
▁acumen 2.3x more frequent
▁multiple▁tasks 2.3x more frequent
▁marketing 2.3x more frequent
economic 2.3x more frequent
▁rent 2.3x more frequent
▁visually▁i 2.3x more frequent
▁but▁are 2.3x more frequent
84 2.3x more frequent
▁customers▁and 2.3x more frequent
▁guarantee 2.3x more frequent
ompletion 2.3x more frequent
▁verifi 2.3x more frequent
▁rn 2.3x more frequent
▁competent 2.3x more frequent
44 2.3x more frequent
▁a▁few 2.3x more frequent
▁specifically 2.3x more frequent
being▁of 2.3x more frequent
▁communicator 2.3x more frequent
▁perfect 2.3x more frequent
▁traditional 2.3x more frequent
▁our▁associates 2.3x more frequent
takes▁initiative 2.3x more frequent
▁an▁experienced 2.2x more frequent
view 2.2x more frequent
▁referral▁bonus 2.2x more frequent
▁and▁marketing 2.2x more frequent
▁counter▁tops 2.2x more frequent
▁two▁years▁of 2.2x more frequent
▁to▁become▁a 2.2x more frequent
▁debit 2.2x more frequent
▁your▁future 2.2x more frequent
▁literacy 2.2x more frequent
▁official 2.2x more frequent
▁class▁a 2.2x more frequent
▁competitive▁pay 2.2x more frequent
▁excess 2.2x more frequent
▁relax 2.2x more frequent
ll▁enjoy 2.2x more frequent
▁sick▁leave 2.2x more frequent
2-4 2.2x more frequent
▁intellectual 2.2x more frequent
registered▁nurse 2.2x more frequent
tax 2.2x more frequent
▁county 2.2x more frequent
▁dependability 2.2x more frequent
▁modify 2.2x more frequent
▁gl 2.2x more frequent
▁is▁the▁law 2.2x more frequent
▁audio 2.2x more frequent
▁to▁prepare 2.2x more frequent
▁flexible▁s 2.2x more frequent
▁best▁in▁class 2.1x more frequent
▁why 2.1x more frequent
▁servicing 2.1x more frequent
▁8:00 2.1x more frequent
▁subcontractor 2.1x more frequent
▁fashion 2.1x more frequent
▁assessing 2.1x more frequent
▁2016 2.1x more frequent
▁developmental 2.1x more frequent
associate▁degree 2.1x more frequent
▁steam 2.1x more frequent
▁overnight 2.1x more frequent
▁commercial 2.1x more frequent
▁temp 2.1x more frequent
connect 2.1x more frequent
▁tracking 2.1x more frequent
▁paid▁training 2.1x more frequent
▁prospect 2.1x more frequent
▁mortgage 2.1x more frequent
▁inspired 2.1x more frequent
▁fastest▁growing 2.1x more frequent
▁rapidly▁growing 2.1x more frequent
▁account▁manager 2.1x more frequent
▁executive 2.1x more frequent
▁we▁specialize 2.1x more frequent
▁christ 2.1x more frequent
credible 2.1x more frequent
▁paycheck 2.1x more frequent
▁whether▁you 2.1x more frequent
▁served 2.1x more frequent
▁rewards 2.1x more frequent
▁you▁will▁be 2.1x more frequent
▁residential 2.1x more frequent
▁premium 2.1x more frequent
▁batch 2.1x more frequent
pplicable▁state 2.1x more frequent
▁admin 2.1x more frequent
▁medications 2.1x more frequent
▁hot 2.1x more frequent
▁submission 2.1x more frequent
▁wire 2.1x more frequent
▁patient▁care 2.1x more frequent
town 2.1x more frequent
▁2019-2020 2.1x more frequent
▁the▁ideal 2.1x more frequent
▁advocate 2.1x more frequent
▁hospitality 2.1x more frequent
volume 2.1x more frequent
fection▁control 2.1x more frequent
▁both▁verbal 2.1x more frequent
▁audiences 2.1x more frequent
▁fantas 2.1x more frequent
▁appreciate 2x more frequent
▁will▁have 2x more frequent
▁compass▁group 2x more frequent
▁embrac 2x more frequent
▁disease 2x more frequent
▁magnet 2x more frequent
▁truck▁driver 2x more frequent
range 2x more frequent
▁grow 2x more frequent
▁our▁communities 2x more frequent
▁and▁ensure 2x more frequent
= 2x more frequent
▁for▁room▁keys 2x more frequent
▁agent 2x more frequent
▁in▁a▁fast 2x more frequent
▁engaged 2x more frequent
customer 2x more frequent
▁bottom 2x more frequent
▁zone 2x more frequent
▁bonuses 2x more frequent
▁marketplace 2x more frequent
▁evaluate 2x more frequent
▁cdl▁class 2x more frequent
gi 2x more frequent
willing▁to▁train 2x more frequent
▁thru▁friday 2x more frequent
▁response 2x more frequent
▁minute 2x more frequent
▁nurse 2x more frequent
▁both▁writ 2x more frequent
,000.00▁/ 2x more frequent

 

Phrases to avoid

The following words were used at least 10 times in both good and bad listings, and occur at least 2x less frequently in good listings as bad listings:

Phrase Frequency
ny▁other▁federal 31.7x less frequent
▁disability▁or▁a 31.4x less frequent
:** 26.3x less frequent
y▁employe 22.2x less frequent
▁yrs 21.4x less frequent
e▁or▁applicant 21.1x less frequent
▁cardinal 20.6x less frequent
▁job▁openings 17.6x less frequent
units▁of▁measure 17.1x less frequent
{ 16.1x less frequent
world 15.2x less frequent
common▁fractions 14.4x less frequent
} 14.4x less frequent
lookup 13.5x less frequent
\ 12.6x less frequent
verify▁employer 12.1x less frequent
ly▁skilled 11.7x less frequent
▁whole▁numbers 10.6x less frequent
▁and▁decimals 10.5x less frequent
▁parking▁lot 10.1x less frequent
▁protected▁class 9.9x less frequent
requisition▁id 9.8x less frequent
t▁take 9.6x less frequent
▁concentra 9.6x less frequent
▁exciting▁career 9.4x less frequent
8.4x less frequent
▁your▁local 8.3x less frequent
▁five▁sta 8.2x less frequent
|| 8.1x less frequent
▁home▁weekly 8.1x less frequent
▁applying▁for 7.9x less frequent
▁catalog 7.9x less frequent
▁our▁service 7.8x less frequent
specialty 7.7x less frequent
▁put▁away 7.7x less frequent
▁office▁at 7.3x less frequent
▁and▁divide 7.3x less frequent
▁salon 7.2x less frequent
7.1x less frequent
ather▁conditions 7x less frequent
climb▁or▁balance 6.7x less frequent
▁company▁driver 6.5x less frequent
▁nicu 6.5x less frequent
lementary 6.5x less frequent
spanish 6.4x less frequent
ade 6.4x less frequent
▁bathrooms 6.4x less frequent
▁assisted▁living 6.4x less frequent
▁locate 6.3x less frequent
rocedure▁manuals 6.3x less frequent
▁status▁as▁a 6x less frequent
▁the▁role 5.9x less frequent
▁cheese 5.9x less frequent
▁courage 5.9x less frequent
disability 5.7x less frequent
▁with▁accounting 5.7x less frequent
▁find▁out▁more 5.7x less frequent
quisition▁number 5.7x less frequent
▁virginia 5.6x less frequent
▁to▁your▁prof 5.6x less frequent
▁penn 5.5x less frequent
▁venue 5.4x less frequent
▁2-3 5.4x less frequent
cademic 5.4x less frequent
▁differ 5.4x less frequent
local 5.4x less frequent
facing 5.3x less frequent
asonable▁a 5.2x less frequent
vets 5.1x less frequent
▁subtract 5x less frequent
▁wipe 5x less frequent
▁orthopedic 4.9x less frequent
_ 4.8x less frequent
are▁for▁patients 4.8x less frequent
▁passenger 4.8x less frequent
▁against▁an 4.8x less frequent
▁safety▁rules 4.7x less frequent
secondary 4.7x less frequent
▁salesperson 4.7x less frequent
ccomplish▁goals 4.6x less frequent
▁virtual 4.6x less frequent
gender▁identity 4.6x less frequent
▁diagnostic 4.6x less frequent
▁crawl 4.6x less frequent
▁dry▁van 4.5x less frequent
▁slot 4.5x less frequent
▁finance▁or 4.4x less frequent
▁concession 4.4x less frequent
▁testing 4.4x less frequent
▁and▁maintenance 4.3x less frequent
▁mexico 4.3x less frequent
paid▁orientation 4.3x less frequent
▁buffet 4.3x less frequent
ham 4.2x less frequent
▁institute 4.2x less frequent
▁cognitive 4.2x less frequent
▁other▁job 4.2x less frequent
▁technological 4.1x less frequent
▁however 4.1x less frequent
▁adventure 4.1x less frequent
▁frequently▁lift 4x less frequent
▁matches 4x less frequent
▁authorized 4x less frequent
▁worldwide 4x less frequent
oak 3.9x less frequent
▁the▁classroom 3.9x less frequent
▁subsidiaries 3.9x less frequent
▁indoor 3.8x less frequent
▁discriminate 3.8x less frequent
▁parts 3.8x less frequent
▁specific▁v 3.8x less frequent
utomotive▁parts 3.8x less frequent
▁cellular 3.8x less frequent
this▁job▁include 3.8x less frequent
▁gaming 3.8x less frequent
▁known▁for▁it 3.8x less frequent
▁dusting 3.8x less frequent
car 3.7x less frequent
▁sandwiches 3.7x less frequent
first▁aid 3.7x less frequent
▁peers 3.7x less frequent
▁exposed 3.6x less frequent
▁the▁sales▁floor 3.6x less frequent
or▁move 3.6x less frequent
▁the▁noise▁level 3.6x less frequent
▁encounter 3.6x less frequent
▁is▁a▁drug 3.6x less frequent
depth▁perception 3.5x less frequent
▁condiment 3.5x less frequent
ly▁lift▁and 3.5x less frequent
▁robust 3.5x less frequent
[ 3.5x less frequent
▁to▁adjust▁focus 3.5x less frequent
▁marital 3.5x less frequent
▁usual 3.5x less frequent
ision▁abilit 3.5x less frequent
ies▁required▁by 3.5x less frequent
| 3.4x less frequent
▁lincoln 3.4x less frequent
▁basic▁math 3.4x less frequent
▁each▁and▁every 3.4x less frequent
▁combined 3.4x less frequent
▁cycle▁count 3.4x less frequent
derly▁condition 3.4x less frequent
▁automotive 3.4x less frequent
▁to▁work▁in▁th 3.4x less frequent
▁rock 3.4x less frequent
e▁united▁states 3.4x less frequent
▁see▁and▁hear 3.3x less frequent
▁phase 3.3x less frequent
▁the▁employee▁is 3.3x less frequent
▁sleep 3.3x less frequent
> 3.3x less frequent
▁achieve 3.3x less frequent
▁with▁parents 3.3x less frequent
▁or▁diagram▁form 3.3x less frequent
▁bulk 3.3x less frequent
▁stocking 3.3x less frequent
▁our▁teachers 3.3x less frequent
] 3.3x less frequent
▁brick 3.2x less frequent
▁to▁find 3.2x less frequent
▁distance▁vision 3.2x less frequent
▁deli 3.2x less frequent
▁install 3.2x less frequent
▁glasses 3.2x less frequent
▁salad 3.2x less frequent
▁protected▁b 3.2x less frequent
▁shelf 3.1x less frequent
trailer 3.1x less frequent
▁franchise 3.1x less frequent
▁trays 3.1x less frequent
▁and▁service 3.1x less frequent
▁employment▁type 3.1x less frequent
▁coupons 3.1x less frequent
▁the▁last 3.1x less frequent
▁* 3.1x less frequent
material▁handler 3x less frequent
▁performing▁the 3x less frequent
▁tomorrow 3x less frequent
▁learn▁and▁grow 3x less frequent
variety▁of▁tasks 3x less frequent
▁on▁the▁road 3x less frequent
▁chemicals 3x less frequent
▁stock▁clerk 3x less frequent
▁outreach 3x less frequent
matched 3x less frequent
▁bottle 3x less frequent
▁and▁interpret 3x less frequent
▁compassion 3x less frequent
▁close▁vision 3x less frequent
▁curious 2.9x less frequent
▁crouch 2.9x less frequent
depth▁knowledge 2.9x less frequent
▁use▁a▁computer 2.9x less frequent
▁gross 2.9x less frequent
▁airport 2.9x less frequent
▁our▁mission▁i 2.9x less frequent
▁destination 2.9x less frequent
▁is▁expected 2.9x less frequent
▁described▁here 2.9x less frequent
berg 2.8x less frequent
▁avoid 2.8x less frequent
▁kneel 2.8x less frequent
▁supplied 2.8x less frequent
▁dignity 2.8x less frequent
▁evening 2.8x less frequent
▁shape 2.8x less frequent
▁champion 2.8x less frequent
▁custodian 2.8x less frequent
▁to▁obtain 2.8x less frequent
▁do▁not 2.7x less frequent
▁job▁category 2.7x less frequent
▁network▁of 2.7x less frequent
▁accreditation 2.7x less frequent
▁cardboard 2.7x less frequent
bound 2.7x less frequent
▁grocery 2.7x less frequent
▁stoop 2.7x less frequent
▁six▁months 2.7x less frequent
▁selling 2.7x less frequent
▁empathy 2.6x less frequent
▁all▁applicants 2.6x less frequent
▁multiply 2.6x less frequent
▁quality▁service 2.6x less frequent
▁the▁employee 2.6x less frequent
america 2.6x less frequent
▁of▁this▁job 2.6x less frequent
professional 2.6x less frequent
▁disinfect 2.6x less frequent
▁feed 2.6x less frequent
client 2.6x less frequent
▁black 2.6x less frequent
▁new▁jersey 2.6x less frequent
▁bathroom 2.6x less frequent
▁sanitizing 2.6x less frequent
▁talk 2.6x less frequent
▁creativity 2.6x less frequent
▁walking 2.6x less frequent
▁fruit 2.5x less frequent
▁utensils 2.5x less frequent
▁$50 2.5x less frequent
▁haul 2.5x less frequent
text 2.5x less frequent
▁gm 2.5x less frequent
▁college▁hunk 2.5x less frequent
▁salt 2.5x less frequent
▁neighborhood 2.5x less frequent
trouble▁shooting 2.5x less frequent
▁with▁or 2.5x less frequent
primary 2.5x less frequent
▁locally▁owned 2.5x less frequent
▁mountain 2.5x less frequent
▁ability▁to▁use 2.5x less frequent
▁sessions 2.4x less frequent
▁red 2.4x less frequent
▁routes 2.4x less frequent
▁work▁in▁a▁team 2.4x less frequent
▁happen 2.4x less frequent
▁disburse 2.4x less frequent
▁club 2.4x less frequent
▁navigat 2.4x less frequent
▁retail▁store 2.4x less frequent
▁beginning 2.4x less frequent
▁such 2.4x less frequent
▁rotate 2.4x less frequent
▁capable 2.4x less frequent
disabled 2.4x less frequent
▁recommend 2.4x less frequent
▁rewarding 2.4x less frequent
ccordance▁with▁c 2.4x less frequent
▁other▁legally 2.4x less frequent
▁eye▁contact 2.4x less frequent
▁those▁that▁m 2.4x less frequent
▁in▁all 2.4x less frequent
▁hands▁and▁arms 2.4x less frequent
▁motivate 2.4x less frequent
▁hear 2.4x less frequent
▁and▁become▁a 2.4x less frequent
▁can▁be 2.4x less frequent
▁knowledge▁and 2.4x less frequent
liquid 2.4x less frequent
▁point▁of▁sale 2.3x less frequent
▁refill 2.3x less frequent
▁our▁patients 2.3x less frequent
▁pursuit 2.3x less frequent
▁encouraging 2.3x less frequent
▁ensure▁that▁the 2.3x less frequent
▁stressful 2.3x less frequent
▁because 2.3x less frequent
▁bag 2.3x less frequent
▁maintain▁an 2.3x less frequent
ust▁be▁met▁by▁an 2.3x less frequent
▁safely 2.3x less frequent
▁+ 2.3x less frequent
▁centers 2.3x less frequent
female 2.3x less frequent
▁mechanical 2.3x less frequent
▁their▁own 2.3x less frequent
truck 2.3x less frequent
▁promise 2.3x less frequent
▁canada 2.3x less frequent
ware 2.3x less frequent
▁join▁our 2.3x less frequent
▁escort 2.3x less frequent
-2019 2.3x less frequent
▁apparel 2.3x less frequent
▁grove 2.3x less frequent
▁recruit 2.3x less frequent
▁want▁to▁be▁p 2.2x less frequent
▁be▁asked▁to 2.2x less frequent
▁beverage 2.2x less frequent
▁stock 2.2x less frequent
▁essential▁job 2.2x less frequent
▁characteristics 2.2x less frequent
▁pizza 2.2x less frequent
▁leadership▁and 2.2x less frequent
▁replace 2.2x less frequent
▁hair 2.2x less frequent
▁speak 2.2x less frequent
▁slice 2.2x less frequent
▁loads 2.2x less frequent
▁silverware 2.2x less frequent
corp 2.2x less frequent
▁ability 2.2x less frequent
▁conviction 2.2x less frequent
▁inside 2.2x less frequent
▁spectrum 2.2x less frequent
▁the▁facility 2.2x less frequent
700 2.2x less frequent
▁sets▁up 2.2x less frequent
▁part▁time 2.2x less frequent
▁pos 2.2x less frequent
▁elements 2.2x less frequent
▁moving 2.2x less frequent
▁source 2.2x less frequent
▁early▁childhood 2.2x less frequent
veteran 2.2x less frequent
▁fleet 2.2x less frequent
▁physical▁demand 2.2x less frequent
▁surpass 2.2x less frequent
▁devise 2.2x less frequent
▁grow▁with▁us 2.2x less frequent
▁starting▁w 2.2x less frequent
most▁importantly 2.2x less frequent
s▁hauling▁junk 2.2x less frequent
▁comprehensive▁b 2.2x less frequent
▁laboratory 2.2x less frequent
▁fact 2.2x less frequent
▁criminal 2.2x less frequent
▁litigation 2.2x less frequent
▁mop 2.2x less frequent
▁award▁winning 2.2x less frequent
~ 2.2x less frequent
** 2.2x less frequent
this 2.1x less frequent
everything▁we▁do 2.1x less frequent
▁patrons 2.1x less frequent
▁urban 2.1x less frequent
76 2.1x less frequent
bl 2.1x less frequent
▁exp 2.1x less frequent
cdl 2.1x less frequent
▁sales▁goals 2.1x less frequent
ly▁perform▁the 2.1x less frequent
centric 2.1x less frequent
▁team▁oriented 2.1x less frequent
▁accidents 2.1x less frequent
▁according▁to▁c 2.1x less frequent
▁straight 2.1x less frequent
▁features 2.1x less frequent
▁english 2.1x less frequent
▁2019 2.1x less frequent
▁or▁expression 2.1x less frequent
▁200 2.1x less frequent
▁reaching 2.1x less frequent
▁surrounding 2.1x less frequent
▁displays 2.1x less frequent
▁curiosity 2.1x less frequent
english▁language 2.1x less frequent
location 2.1x less frequent
hc 2.1x less frequent
▁certain 2.1x less frequent
▁captain 2.1x less frequent
▁pump 2.1x less frequent
▁expected 2.1x less frequent
▁typically 2.1x less frequent
▁carts 2x less frequent
▁join▁our▁team 2x less frequent
food▁preparation 2x less frequent
▁phone▁calls 2x less frequent
▁$11 2x less frequent
75 2x less frequent
y▁applicable▁law 2x less frequent
shed▁in▁written 2x less frequent
▁library 2x less frequent
▁transport 2x less frequent
▁operating 2x less frequent
▁kansas 2x less frequent
▁item 2x less frequent
▁basic 2x less frequent
▁a▁difference 2x less frequent
▁scholars 2x less frequent
▁sign▁on▁bonus 2x less frequent
hauling 2x less frequent
▁di 2x less frequent
▁cases 2x less frequent
▁to▁successful 2x less frequent
▁restroom 2x less frequent
▁sweep▁and▁mop 2x less frequent
▁working▁in 2x less frequent
▁prepared 2x less frequent
▁suppliers 2x less frequent
▁blend 2x less frequent

 

Putting it in context

provides professional nursing care for the comfort and well-being of patients. prepares equipment and assists physician during examinations and treatments. administers prescribed medications, changes dressings, cleans wounds, and monitors patient vital signs. observes and maintains records on patient care, condition, reaction, and progress. requirements graduate of an accredited school of nursing current louisiana state rn license current american heart association basic life support must be able to communicate effectively and professionally with patients, families, and medical staff both verbally and written one (1) year of gi nursing experience preferred

matches highly skilled professionals with accounting finance jobs at the best companies on a temporary and temporary-to-hire basis. our mission is to provide you with a rewarding finance or accounting job that is well matched to your professional skills helping you to advance in your career. our experience, combined with the resources of our worldwide network of offices, makes us a great resource for your career. we offer excellent opportunities to find temporary accounting and finance jobs for all experience levels. from accounting clerks and bookkeepers to accounts payable and staff accountants, we can provide you unparalleled access to exciting career opportunities. but don’t take our word for it. our company has appeared on fortune® magazine’s list of “world‘s most admired companies” since 1998, and 9 out of 10 of our customers would recommend our service to a colleague. contact your local accountemps office at 888-490-3195 or visit our website to apply for this job now or find out more about other job opportunities. all applicants applying for u.s. job openings must be authorized to work in the united states. all applicants applying for canadian job openings must be authorized to work in canada. © 2019 an equal opportunity employer m/f/disability/veterans by clicking ‘apply now‘ you are agreeing to robert half terms of use.

Takeaways

Avoid clichés

Avoid phrases like “don’t take our word for it”, and “each and every”. Clichés are not only inauthentic, but also a waste of valuable space.

Avoid stating the obvious

The phrase “described here”, and “find out more” is negative. “Connect with us” and “facebook” are positive.

Don’t try to oversell

Companies with low ratings tend to use phrases like “exciting career”, “our mission is”, “everything we do”, and “award winning”.

Nobody wants to read a list of rules

Phrases like “required by”, “all applicants”, “is expected” don’t do very well. Don’t focus on what the employee can do for you.

Do focus on what employees can do for others. Phrases like “ensure quality”, “customer focus” are good. Phrases like “highly desired” make employees feel wanted.

Employees like choices

Phrases like “or part time”, “other duties”, “also includes”, and “negotiable” are positive.

Employees like benefits

Phrases like “weekly pay”, “plus benefits”, and “rewards program” do well. Not all benefits are good; “sign on bonus” is a negative phrase.

Certain industries are just more enjoyable than others

The registered nurse jobs tended to do very well. Others did not do so well. Attractive industries tend to be the most efficient. As an employee they’re the hardest jobs to get, and as a business owner, they’re the hardest to compete in.

The same job can sound more appealing depending how it’s phrased. “Prepare food”, and “foodservice” is a positive phrase. “Food preparation” is a negative phrase.

Bonus: applying LDA topic modeling

We can apply latent dirichlet allocation (LDA) topic modeling to job descriptions to find similar jobs. This is a natural extension of bag of words, and other naive frequency models. Documents have a distribution of topics, and topics are a distribution of words.

Here is the code:

tokenized_descriptions = [sp.EncodeAsPieces(doc) for job_description in job_descriptions]
dictionary = gensim.corpora.Dictionary(tokenized_descriptions)
dictionary.filter_extremes(no_below=4, no_above=0.3)
corpus = [dictionary.doc2bow(tokenized_description) for tokenized_description in tokenized_descriptions]
if not os.path.isfile(model_path):
    print('Training topic model...')
    lda_model = gensim.models.ldamulticore.LdaMulticore(corpus=corpus,num_topics=20,id2word=dictionary,chunksize=100,workers=7,passes=50,eval_every=1,per_word_topics=True)
    lda_model.save(model_path)
else:
    lda_model = gensim.models.ldamodel.LdaModel.load(model_path)
    lda_model.print_topics()

Example job description:

the primary responsibilities of the janitor a involve the upkeep of the property in order to enhance and maintain its curb appeal. the janitor a will also assist the rest of the staff, as directed. duties and responsibilities: conduct all business in accordance with the habitat company’s policies and procedures, state and federal laws; e.g. osha, ada, fair housing etc. perform activities to maintain the continuity of essential environmental services in order to guarantee resident comfort and security. maintains awareness of proper safety precautions at all times. complete assigned work orders according to company guidelines. complete final work of all units turned over for leasing. performs electrical repairs on items such as appliances, fixtures, switches, outlets, circuits, etc. performs plumbing work, such as clearing stoppages, replacing fittings, etc. replaces tile, carpet, screens, garbage disposals, fixtures, appliances, blinds, locks, etc. paints interior and exterior. performs scheduled maintenance on all equipment based on the manufacturer’s recommendations and operating manuals. has knowledge regarding water and gas cutoffs, all units and fixtures cutoffs and sewer clean outs. assists in unit move in and move out inspections. removes and transfers heavy appliances and equipment from storage area to apartment as necessary. full time maintenance experience required concern for work-safety programs. ability to participate in a standby emergency schedule for evening, weekend, and holiday coverage. strong plumbing skills required successful completion of the seiu local 1 two-year apprenticeship program or ability to complete upon hire

The LDA model correctly identified the topic:

67.0% topic 17
0.006” warehouse” + 0.006” cleaning” + 0.006” equipment” + 0.004” items” + 0.004” clean” + 0.004” inventory” + 0.004” perform” + 0.004” must be able to” + 0.004” orders” + 0.004” safety” + 0.003” duties” + 0.003” stock” + 0.003” areas” + 0.003” area” + 0.003” responsible for” + 0.003” shift” + 0.003” proper” + 0.003” maintenance” + 0.003” maintain” + 0.003” product” + 0.003” up to” + 0.003” as needed” + 0.003” materials” + 0.003” in a” + 0.003” ensure” + 0.003” standards” + 0.003” daily” + 0.003” lift” + 0.003” as assigned” + 0.002” supplies” + 0.002” lbs” + 0.002” any” + 0.002” physical” + 0.002” products” + 0.002” order” + 0.002“ers” + 0.002” service” + 0.002” pounds” + 0.002” food” + 0.002” merchandise” + 0.002” re” + 0.002” procedures” + 0.002” trash” + 0.002” shipping” + 0.002” etc” + 0.002” floors” + 0.002” furniture” + 0.002” working” + 0.002” clean and” + 0.002” must be” + 0.002” safe” + 0.002“up” + 0.002” other duties” + 0.002” assigned” + 0.002” such as” + 0.002“w” + 0.002” using” + 0.002” and other” + 0.002“g” + 0.002” forklift” + 0.002” school diploma” + 0.002” complete” + 0.002” hours” + 0.002” other” + 0.002” policies” + 0.002” receiving” + 0.002” general” + 0.002“in” + 0.002” cleanliness” + 0.002” performs” + 0.002” position” + 0.002” hand” + 0.002” 50″ + 0.002” floor” + 0.002” &” + 0.002” to the” + 0.002” operate” + 0.002” department” + 0.002” /” + 0.002” tasks” + 0.002” attendant” + 0.002” job description” + 0.002” maintains” + 0.002” when” + 0.002” up” + 0.002” accurately” + 0.002” manner” + 0.002” follow” + 0.002” supervisor” + 0.002” or equivalent” + 0.002” lifting” + 0.002” move” + 0.002” must” + 0.002” and equipment” + 0.002” may” + 0.001” communicate” + 0.001” check” + 0.001” quality” + 0.001” use” + 0.001” storage”

Future improvements

This analysis was done on 25 MB worth of job description text. Ten to one hundred times more data would have been better. I also did not do any data balancing/controls. The purpose of this post was to show the process, and some of the fundamentals of Applicant Tracking Systems (ATS).


About the author



Hi, I'm Nathan. Thanks for reading! Keep an eye out for more content being posted soon.


Leave a Reply

Your email address will not be published. Required fields are marked *