\u201cNEC cotomi Pro\u201d and \u201cNEC cotomi Light\u201d achieve the same quality as global models at more than 10 times the speed<\/p>\n
NEC Corporation (NEC; TSE: 6701) has expanded its \u201cNEC cotomi\u201d generative AI services with the development of “NEC cotomi Pro” and “NEC cotomi Light,” two new high-speed generative AI Large Language Models (LLM) featuring updated training data and architectures.<\/p>\n
With the rapid development of generative AI in recent years, a wide range of organizations have been considering and verifying business transformation using LLMs. As specific application scenarios emerge, there is a need to provide models and formats that meet customer needs in terms of response time, business data coordination, information protection and other security aspects during implementation and operation.<\/p>\n
NEC\u2019s newly developed NEC cotomi Pro and NEC cotomi Light are high-speed, high-performance models that deliver the same high performance as global LLMs, but at more than ten times the speed.<\/p>\n
Generally, to improve the performance of an LLM, a model needs to be made larger, but this slows down the operating speed. However, NEC has succeeded in improving both speed and performance with the development of an advanced new training method and architecture.<\/p>\n
“NEC cotomi Pro” achieves performance comparable to top-level global models such as \u201cGPT-4\u201d and \u201cClaude 2,\u201d with a response time that is approximately 87% faster than GPT-4 using an infrastructure of two graphics processing units (GPU). In addition, the even faster “NEC cotomi Light” has the same level of performance as global models such as \u201cGPT-3.5-Turbo,\u201d but can process a large number of requests at high speed with an infrastructure of about 1 to 2 GPU, providing sufficient performance for many tasks.<\/p>\n
Specifically, in an in-house document retrieval system using a technique called RAG, the system achieved a correct response rate higher than GPT-3.5 without fine-tuning and a correct response rate higher than GPT-4 after fine-tuning, with a response time that is approximately 93% faster.<\/p>\n
Features of NEC cotomi Pro and NEC cotomi Light<\/strong><\/p>\n Both “NEC cotomi Pro” and “NEC cotomi Light” have high levels of processing power that are at the top level globally in terms of knowledge and ability to handle various tasks, such as document summarization, logical reasoning, and question answering.<\/p>\n","protected":false},"excerpt":{"rendered":" \u201cNEC cotomi Pro\u201d and \u201cNEC cotomi Light\u201d achieve the same quality as global models at more than 10 times the speed NEC Corporation (NEC; TSE: 6701) has expanded its \u201cNEC cotomi\u201d generative AI services with the development of “NEC cotomi Pro” and “NEC cotomi Light,” two new high-speed generative AI Large Language Models (LLM) featuring\u2026<\/p>\n","protected":false},"author":2,"featured_media":18040,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_scj_primary_category_id":55,"_scj_featured":false,"_scj_featured_from":"","_scj_featured_until":"","_scj_featured_order":0,"_scj_visibility_class":"current","_scj_layout_family":"standard","_scj_article_style":"","_scj_display_overrides":[],"_scj_intro_image_id":18040,"_scj_intro_alt":"NEC Develops High-speed Generative AI Large Language Models (LLM) with World-class Performance","_scj_intro_caption":"","_scj_intro_class":"","_scj_intro_float":"","_scj_full_image_id":18040,"_scj_full_alt":"NEC Develops High-speed Generative AI Large Language Models (LLM) with World-class Performance","_scj_full_caption":"","_scj_full_class":"","_scj_full_float":"","_scj_media_type":"","_scj_media_provider":"","_scj_media_external_id":"","_scj_media_url":"","_scj_media_poster_id":0,"_scj_media_width":0,"_scj_media_height":0,"_scj_media_aspect_ratio":"","_scj_media_description":"","_scj_gallery_items":[],"_scj_related_post_ids":[],"_scj_additional_authors":[],"scj_layout_family":"standard","scj_media_provider":"","scj_media_url":"","scj_full_caption":"","footnotes":""},"categories":[55],"tags":[],"class_list":["post-18041","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence"],"yoast_head":"\n\n