BERTopic_20newsgroups_base

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

from bertopic import BERTopic
topic_model = BERTopic.load("alexman83/BERTopic_20newsgroups_base")

topic_model.get_topic_info()

Topic overview

• Number of topics: 224
• Number of training documents: 18846

Click here for an overview of all topics.

Topic ID	Topic Keywords	Topic Frequency	Label
-1	to - the - and - of - is	10	-1_to_the_and_of
0	game - team - games - he - players	6636	0_game_team_games_he
1	key - clipper - chip - encryption - keys	1820	1_key_clipper_chip_encryption
2	ites - cheek - yep - huh - eh	584	2_ites_cheek_yep_huh
3	drive - scsi - drives - ide - disk	527	3_drive_scsi_drives_ide
4	israel - israeli - arab - arabs - jews	434	4_israel_israeli_arab_arabs
5	ram - sale - price - drive - pc	357	5_ram_sale_price_drive
6	jpeg - image - gif - format - images	262	6_jpeg_image_gif_format
7	gay - sex - homosexual - sexual - men	167	7_gay_sex_homosexual_sexual
8	amp - audio - stereo - asking - condition	165	8_amp_audio_stereo_asking
9	atheists - god - atheism - atheist - belief	159	9_atheists_god_atheism_atheist
10	bike - tires - tire - bikes - miles	159	10_bike_tires_tire_bikes
11	car - ford - mustang - engine - cars	150	11_car_ford_mustang_engine
12	printer - print - hp - deskjet - ink	150	12_printer_print_hp_deskjet
13	space - moon - station - nasa - launch	149	13_space_moon_station_nasa
14	fire - fbi - gas - tear - bds	140	14_fire_fbi_gas_tear
15	mhz - clock - cpu - speed - fpu	129	15_mhz_clock_cpu_speed
16	gun - guns - crime - deaths - firearms	126	16_gun_guns_crime_deaths
17	health - tobacco - cesarean - smokeless - malaria	119	17_health_tobacco_cesarean_smokeless
18	window - widget - event - expose - application	118	18_window_widget_event_expose
19	armenian - armenians - turkish - genocide - turkey	109	19_armenian_armenians_turkish_genocide
20	jews - nazis - nazi - hitler - jewish	105	20_jews_nazis_nazi_hitler
21	monitor - monitors - vga - horizontal - nec	104	21_monitor_monitors_vga_horizontal
22	den - polygon - points - algorithm - xxxx	103	22_den_polygon_points_algorithm
23	3d - graphics - conference - nok - grafsys	99	23_3d_graphics_conference_nok
24	msg - food - chinese - foods - taste	98	24_msg_food_chinese_foods
25	simms - simm - vram - ram - meg	96	25_simms_simm_vram_ram
26	symbol - error - undefined - libxmulibxmuso - doug	90	26_symbol_error_undefined_libxmulibxmuso
27	windows - os2 - nt - dos - slip	84	27_windows_os2_nt_dos
28	islam - quran - islamic - rushdie - muslims	83	28_islam_quran_islamic_rushdie
29	serbs - muslims - stephanopoulos - bosnia - mr	82	29_serbs_muslims_stephanopoulos_bosnia
30	games - joystick - sega - game - arcade	78	30_games_joystick_sega_game
31	pain - diet - migraine - cancer - drug	77	31_pain_diet_migraine_cancer
32	homosexuality - homosexual - paul - sex - homosexuals	75	32_homosexuality_homosexual_paul_sex
33	koresh - batf - compound - fbi - children	74	33_koresh_batf_compound_fbi
34	db - mov - windows - memory - blbh	74	34_db_mov_windows_memory
35	rx - server - remote - xterm - xb	74	35_rx_server_remote_xterm
36	pom - cds - sale - cd - picture	70	36_pom_cds_sale_cd
37	modem - fax - modems - courier - v32bis	69	37_modem_fax_modems_courier
38	drivers - card - diamond - driver - windows	69	38_drivers_card_diamond_driver
39	medical - medicine - doctor - cure - patient	67	39_medical_medicine_doctor_cure
40	batf - warrant - raid - assault - compound	63	40_batf_warrant_raid_assault
41	sky - advertising - billboard - billboards - light	56	41_sky_advertising_billboard_billboards
42	tax - income - taxes - deficit - vat	55	42_tax_income_taxes_deficit
43	ham - radio - interference - antenna - rf	54	43_ham_radio_interference_antenna
44	hell - eternal - god - jesus - heaven	54	44_hell_eternal_god_jesus
45	radar - detector - detectors - ka - alarm	53	45_radar_detector_detectors_ka
46	joke - sarcastic - human - you - rights	52	46_joke_sarcastic_human_you
47	mary - her - she - bernadette - sin	51	47_mary_her_she_bernadette
48	copy - protection - program - backup - software	48	48_copy_protection_program_backup
49	books - canon - scripture - bible - hebrew	47	49_books_canon_scripture_bible
50	hst - reboost - mission - shuttle - orbit	47	50_hst_reboost_mission_shuttle
51	smiley - bolick - heil - maddi - nickname	47	51_smiley_bolick_heil_maddi
52	law - aaron - jesus - sin - baptism	46	52_law_aaron_jesus_sin
53	waco - reno - fbi - clinton - janet	46	53_waco_reno_fbi_clinton
54	science - methodology - scientific - theory - empirical	46	54_science_methodology_scientific_theory
55	venus - space - balloon - kilometers - propulsion	45	55_venus_space_balloon_kilometers
56	greek - greece - turkish - greeks - cyprus	44	56_greek_greece_turkish_greeks
57	paint - wax - plastic - scratches - finish	43	57_paint_wax_plastic_scratches
58	battery - batteries - concrete - discharge - temperature	43	58_battery_batteries_concrete_discharge
59	were - armenians - they - azerbaijan - her	42	59_were_armenians_they_azerbaijan
60	insurance - geico - car - accident - rates	42	60_insurance_geico_car_accident
61	cop - ticket - drunk - driving - court	42	61_cop_ticket_drunk_driving
62	mouse - driver - mice - ball - problem	42	62_mouse_driver_mice_ball
63	militia - amendment - arms - bear - right	42	63_militia_amendment_arms_bear
64	wave - ride - bikers - bike - riding	41	64_wave_ride_bikers_bike
65	entry - file - oname - entries - char	41	65_entry_file_oname_entries
66	jehovah - elohim - lord - mormon - mcconkie	41	66_jehovah_elohim_lord_mormon
67	miles - toyota - amfm - condition - cassette	41	67_miles_toyota_amfm_condition
68	drugs - drug - cocaine - marijuana - illegal	41	68_drugs_drug_cocaine_marijuana
69	kuwait - iraq - iran - gulf - arabia	41	69_kuwait_iraq_iran_gulf
70	test - polysyllabic - abo - deane - deanebinahccbrandeisedu	40	70_test_polysyllabic_abo_deane
71	duo - clock - date - bios - battery	40	71_duo_clock_date_bios
72	knepper - you - posts - your - freeman	39	72_knepper_you_posts_your
73	dog - dogs - bike - chase - trained	38	73_dog_dogs_bike_chase
74	clutch - shift - transmission - shifting - gear	38	74_clutch_shift_transmission_shifting
75	oort - cloud - grbs - gamma - burst	38	75_oort_cloud_grbs_gamma
76	tape - tapes - backup - drive - munroe	37	76_tape_tapes_backup_drive
77	trial - cooper - weaver - spence - witnesses	37	77_trial_cooper_weaver_spence
78	water - dept - phd - energy - environmental	36	78_water_dept_phd_energy
79	oil - drain - car - leaks - cars	36	79_oil_drain_car_leaks
80	moral - morality - immoral - morals - hudson	36	80_moral_morality_immoral_morals
81	mbytes - windows - dos - ms - mouse	36	81_mbytes_windows_dos_ms
82	newsgroup - newsgroups - voting - votes - group	35	82_newsgroup_newsgroups_voting_votes
83	tomb - resurrection - jesus - disciples - he	35	83_tomb_resurrection_jesus_disciples
84	deleted - stuff - hurts - followups - deletion	35	84_deleted_stuff_hurts_followups
85	fonts - font - tt - truetype - atm	35	85_fonts_font_tt_truetype
86	penalty - cruel - death - punishment - murder	34	86_penalty_cruel_death_punishment
87	ripem - key - des - rsa - cipher	34	87_ripem_key_des_rsa
88	kirlian - photography - leaf - pictures - krillean	34	88_kirlian_photography_leaf_pictures
89	libertarians - government - libertarian - regulation - libertarianism	34	89_libertarians_government_libertarian_regulation
90	ra - satan - god - thou - lucifer	34	90_ra_satan_god_thou
91	celp - dsp - voice - speech - 4800	33	91_celp_dsp_voice_speech
92	countersteering - bike - motorcycle - lean - technique	32	92_countersteering_bike_motorcycle_lean
93	exist - existence - god - evolution - why	32	93_exist_existence_god_evolution
94	fan - cpu - heat - sink - fans	32	94_fan_cpu_heat_sink
95	marriage - married - marry - ceremony - church	32	95_marriage_married_marry_ceremony
96	planets - spacecraft - solar - planet - earth	32	96_planets_spacecraft_solar_planet
97	board - connector - powerbook - chip - labeled	31	97_board_connector_powerbook_chip
98	1st - wolverine - comics - hulk - art	31	98_1st_wolverine_comics_hulk
99	irq - port - ports - com - com3	31	99_irq_port_ports_com
100	gc - mydisplay - draw - color - drawing	30	100_gc_mydisplay_draw_color
101	insurance - health - private - care - canada	30	101_insurance_health_private_care
102	moral - objective - morality - morals - relativism	30	102_moral_objective_morality_morals
103	probe - spacecraft - mission - mars - probes	29	103_probe_spacecraft_mission_mars
104	ghostscript - postscript - pageview - ghostview - dsc	29	104_ghostscript_postscript_pageview_ghostview
105	hacker - hackers - computer - ethic - cs	29	105_hacker_hackers_computer_ethic
106	professors - university - schools - class - champaignurbana	29	106_professors_university_schools_class
107	candida - yeast - yogurt - infections - acidophilus	29	107_candida_yeast_yogurt_infections
108	scanner - logitech - ocr - scanman - scanners	28	108_scanner_logitech_ocr_scanman
109	myers - stephanopoulos - president - ms - mr	28	109_myers_stephanopoulos_president_ms
110	monitor - off - turn - computer - electricity	27	110_monitor_off_turn_computer
111	xv - copyright - donation - shareware - author	27	111_xv_copyright_donation_shareware
112	mode - vesa - modes - vga - video	27	112_mode_vesa_modes_vga
113	lane - behind - car - jerk - lanes	27	113_lane_behind_car_jerk
114	winbench - vlb - graphite - stealth - winmarks	26	114_winbench_vlb_graphite_stealth
115	pds - nubus - lc - slot - card	26	115_pds_nubus_lc_slot
116	kidney - stones - b6 - hernia - pain	26	116_kidney_stones_b6_hernia
117	modem - dce - cts - dtr - dte	26	117_modem_dce_cts_dtr
118	truth - absolute - bible - arrogance - absolutes	26	118_truth_absolute_bible_arrogance
119	card - ati - cards - orchid - s3	26	119_card_ati_cards_orchid
120	maxaxaxaxaxaxaxaxaxaxaxaxaxaxax - mg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9v - m4 - mp - 14	26	120_maxaxaxaxaxaxaxaxaxaxaxaxaxaxax_mg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9vg9v_m4_mp
121	dealer - price - saturn - car - invoice	26	121_dealer_price_saturn_car
122	monitor - problem - monitors - apple - video	25	122_monitor_problem_monitors_apple
123	shaft - wheelie - wheelies - shaftdrive - rear	25	123_shaft_wheelie_wheelies_shaftdrive
124	helmet - liner - foam - cb - helmets	25	124_helmet_liner_foam_cb
125	lens - camera - nikon - zoom - pouch	25	125_lens_camera_nikon_zoom
126	jb - polio - patients - muscle - postpolio	24	126_jb_polio_patients_muscle
127	moment - cult - schools - silence - religion	24	127_moment_cult_schools_silence
128	dos - cluster - fat - doubledisk - windows	24	128_dos_cluster_fat_doubledisk
129	lock - kryptonite - cable - locks - bike	23	129_lock_kryptonite_cable_locks
130	scope - scopes - oscilloscope - tektronix - probes	23	130_scope_scopes_oscilloscope_tektronix
131	scrolls - books - qumran - symposium - book	22	131_scrolls_books_qumran_symposium
132	context - jim - articles - telepathy - you	22	132_context_jim_articles_telepathy
133	nuclear - weapons - plutonium - weapon - clancy	22	133_nuclear_weapons_plutonium_weapon
134	dial - number - phone - call - line	22	134_dial_number_phone_call
135	pope - church - schism - father - catholic	22	135_pope_church_schism_father
136	midi - driver - sound - blaster - soundblaster	21	136_midi_driver_sound_blaster
137	motto - freedom - speech - offensive - recordings	21	137_motto_freedom_speech_offensive
138	stuffit - files - system - disk - ftp	21	138_stuffit_files_system_disk
139	clinton - screw - step - bush - administration	21	139_clinton_screw_step_bush
140	windows - ini - uninstall - program - autoexecbat	20	140_windows_ini_uninstall_program
141	room - bedroom - summer - kitchen - washer	20	141_room_bedroom_summer_kitchen
142	cancer - center - centers - medical - research	20	142_cancer_center_centers_medical
143	pkzip - windows - quinzip - winzip - blind	20	143_pkzip_windows_quinzip_winzip
144	prophecies - prophecy - scripture - lord - god	19	144_prophecies_prophecy_scripture_lord
145	cooling - water - steam - towers - plants	19	145_cooling_water_steam_towers
146	eye - prk - cornea - rk - glasses	19	146_eye_prk_cornea_rk
147	god - will - shall - thee - heaven	19	147_god_will_shall_thee
148	colors - color - bit - 24 - rgb	19	148_colors_color_bit_24
149	tempest - monitor - equipment - radiation - emissions	19	149_tempest_monitor_equipment_radiation
150	son - god - jesus - father - trinity	18	150_son_god_jesus_father
151	revolver - kratz - gun - glock - safety	18	151_revolver_kratz_gun_glock
152	sampling - oversampling - filter - rate - digital	18	152_sampling_oversampling_filter_rate
153	thyroid - depression - nutrition - her - thyroxin	18	153_thyroid_depression_nutrition_her
154	motif - bindings - cosecomplient - toolkit - interviews	18	154_motif_bindings_cosecomplient_toolkit
155	bmw - list - bmws - r80 - matty	18	155_bmw_list_bmws_r80
156	dialing - tone - sweden - phone - germany	18	156_dialing_tone_sweden_phone
157	ks - book - author - assistants - books	18	157_ks_book_author_assistants
158	ms - survey - microsoft - users - msdos	18	158_ms_survey_microsoft_users
159	chemistry - vinge - book - paperback - spice	17	159_chemistry_vinge_book_paperback
160	boards - blue - leds - solder - green	17	160_boards_blue_leds_solder
161	wsm - windows - paradox - sharewarefreeware - software	17	161_wsm_windows_paradox_sharewarefreeware
162	xman - iccm - xservers - 9000700 - examples	17	162_xman_iccm_xservers_9000700
163	lights - backing - car - reverse - backup	17	163_lights_backing_car_reverse
164	ca - bbs - 818 - 805 - 408	17	164_ca_bbs_818_805
165	jacket - womens - pants - clothing - pockets	16	165_jacket_womens_pants_clothing
166	zane - 2ti - church - book - faith	16	166_zane_2ti_church_book
167	odometer - sensor - speedo - mileage - dash	16	167_odometer_sensor_speedo_mileage
168	easter - resurrection - pagan - goddess - celebration	16	168_easter_resurrection_pagan_goddess
169	font - fonts - pi - 8514a - windows	16	169_font_fonts_pi_8514a
170	pgp - code - public - source - encryption	16	170_pgp_code_public_source
171	article - quoting - ericksonazurenmtedu - velapoldi - may14021136199325219athosrutgersedu	16	171_article_quoting_ericksonazurenmtedu_velapoldi
172	data - image - ftp - grass - sgi	16	172_data_image_ftp_grass
173	42 - tea - question - answer - universe	16	173_42_tea_question_answer
174	rotor - aluminum - oven - oil - militech	16	174_rotor_aluminum_oven_oil
175	uv - bulb - bulbs - light - blinker	16	175_uv_bulb_bulbs_light
176	abortion - abortions - women - choice - pregnancy	15	176_abortion_abortions_women_choice
177	ups - stock - chaparral - coupons - mailbox	15	177_ups_stock_chaparral_coupons
178	sabbath - moses - tablets - commandments - ten	15	178_sabbath_moses_tablets_commandments
179	clinton - reagan - bush - fingers - rush	15	179_clinton_reagan_bush_fingers
180	ground - grounding - conductor - neutral - wire	15	180_ground_grounding_conductor_neutral
181	keycode - xtermmap - definekey - key - numlock	15	181_keycode_xtermmap_definekey_key
182	powerpc - apple - dock - macs - duo	15	182_powerpc_apple_dock_macs
183	quack - candida - lyme - quacks - bloom	15	183_quack_candida_lyme_quacks
184	diesel - diesels - emissions - fuel - cleaner	15	184_diesel_diesels_emissions_fuel
185	crohns - inflammation - patients - colonics - colitis	15	185_crohns_inflammation_patients_colonics
186	cview - temp - directory - files - disk	15	186_cview_temp_directory_files
187	ear - wax - ears - syringe - hearing	14	187_ear_wax_ears_syringe
188	machine - register - beeps - error - memory	14	188_machine_register_beeps_error
189	blacks - african - white - culture - americans	14	189_blacks_african_white_culture
190	table - drawer - tables - glass - chairs	14	190_table_drawer_tables_glass
191	oo - christian - christianity - convenient - christians	14	191_oo_christian_christianity_convenient
192	voltage - amp - bell - bel - ampere	14	192_voltage_amp_bell_bel
193	needles - acupuncture - needle - syringe - hypodermic	14	193_needles_acupuncture_needle_syringe
194	life - my - kendigianism - you - do	14	194_life_my_kendigianism_you
195	rosicrucian - rosicrucians - amorc - lectorium - crucis	14	195_rosicrucian_rosicrucians_amorc_lectorium
196	meningitis - infection - antibiotics - fungal - exposure	14	196_meningitis_infection_antibiotics_fungal
197	concealed - carry - weapon - carrying - freeman	13	197_concealed_carry_weapon_carrying
198	hotel - voucher - vacation - nights - reservation	13	198_hotel_voucher_vacation_nights
199	tongues - language - speak - tounges - church	13	199_tongues_language_speak_tounges
200	clv - contains - min - 2000 - tune	13	200_clv_contains_min_2000
201	smokey - movies - bandit - yogi - wheels	13	201_smokey_movies_bandit_yogi
202	anonymous - encryption - anonymity - posting - technology	12	202_anonymous_encryption_anonymity_posting
203	pray - lunch - news - subhuman - sex	12	203_pray_lunch_news_subhuman
204	memory - shared - server - pixmaps - xputimage	12	204_memory_shared_server_pixmaps
205	sin - hate - love - sinner - hating	12	205_sin_hate_love_sinner
206	8051 - nextstep - hendry - assembler - signetics	12	206_8051_nextstep_hendry_assembler
207	religion - motivated - religously - crusades - wars	12	207_religion_motivated_religously_crusades
208	image - processing - analysis - tools - plplot	12	208_image_processing_analysis_tools
209	manhattan - beauchaine - bobbeviceicotekcom - sank - bronx	12	209_manhattan_beauchaine_bobbeviceicotekcom_sank
210	colormap - colormaps - colors - color - standard	12	210_colormap_colormaps_colors_color
211	wasps - chiggers - centipedes - millipedes - polish	12	211_wasps_chiggers_centipedes_millipedes
212	cancer - burzynskis - a10 - tumor - cell	12	212_cancer_burzynskis_a10_tumor
213	phone - onhook - tip - ring - led	11	213_phone_onhook_tip_ring
214	s414 - bill - bills - senate - brady	11	214_s414_bill_bills_senate
215	lines - airplanes - mattell - themey - saber	11	215_lines_airplanes_mattell_themey
216	thread - origonal - enlightening - rectify - appended	11	216_thread_origonal_enlightening_rectify
217	woof - ditto - uckers - tuna - critus	11	217_woof_ditto_uckers_tuna
218	xxxxx - detector - ir - selspot - position	11	218_xxxxx_detector_ir_selspot
219	weight - fat - muscle - adiposity - dieting	11	219_weight_fat_muscle_adiposity
220	8177 - techniciandr - student - dod - indiscretions	10	220_8177_techniciandr_student_dod
221	multicolumn - motif - widget - widgets - list	10	221_multicolumn_motif_widget_widgets
222	her - passenger - ride - she - bike	10	222_her_passenger_ride_she

Training hyperparameters

• calculate_probabilities: True
• language: english
• low_memory: False
• min_topic_size: 10
• n_gram_range: (1, 1)
• nr_topics: None
• seed_topic_list: None
• top_n_words: 10
• verbose: True
• zeroshot_min_similarity: 0.7
• zeroshot_topic_list: None

Framework versions

• Numpy: 1.26.3
• HDBSCAN: 0.8.33
• UMAP: 0.5.5
• Pandas: 2.1.4
• Scikit-Learn: 1.3.2
• Sentence-transformers: 2.5.1
• Transformers: 4.38.2
• Numba: 0.59.0
• Plotly: 5.19.0
• Python: 3.10.13