10+ medical models for Summarization, NER, Classification, DEID and more in John Snow Labs NLU 5.1.2
We are announcing NLU 5.1.2 with new pipelines and bug fixes.
10+ new medical ner, summarization, classification, mapper, deidentification healthcare pipelines has been added!
New Healthcare Pipelines
| Language | nlu.load() reference | Spark NLP reference |
|---|---|---|
| Arabic | ar.deid.clinical | clinical_deidentification |
| English | en.summarize.biomedical_pubmed.pipeline | summarizer_biomedical_pubmed_pipeline |
| English | en.ner.oncology.pipeline | ner_oncology_pipeline |
| English | en.ner.oncology_response_to_treatment.pipeline | ner_oncology_response_to_treatment_pipeline |
| English | en.med_ner.vop.pipeline | ner_vop_pipeline |
| English | en.med_ner.vop_demographic.pipeline | ner_vop_demographic_pipeline |
| English | en.med_ner.vop_treatment.pipeline | ner_vop_treatment_pipeline |
| English | en.med_ner.vop_problem.pipeline | ner_vop_problem_pipeline |
| English | en.classify.bert_sequence.vop_hcp_consult.pipeline | bert_sequence_classifier_vop_hcp_consult_pipeline |
| English | en.classify.bert_sequence.vop_drug_side_effect.pipeline | bert_sequence_classifier_vop_drug_side_effect_pipeline |
| English | en.map_entity.rxnorm_resolver.pipe | rxnorm_resolver_pipeline) |
Bugfixes
- Fixed a bug that caused some Chunk Mapper based pretrained pipelines to throw exceptions
- Fixed bug that caused pretrained some pipes with sentence embed converters to crash
📖 Additional NLU resources
- 140+ NLU Tutorials
- Streamlit visualizations docs
- The complete list of all 20000+ models & pipelines in 300+ languages is available on Models Hub
- Spark NLP publications
- NLU documentation
- Discussions Engage with other community members, share ideas, and show off how you use Spark NLP and NLU!
Installation
#PyPI
pip install nlu pyspark