{"id":15489,"date":"2023-06-05T06:38:23","date_gmt":"2023-06-05T04:38:23","guid":{"rendered":"https:\/\/thesmartcityjournal.cibeles.net\/sin-categoria\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\/"},"modified":"2025-02-20T12:17:58","modified_gmt":"2025-02-20T11:17:58","slug":"how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved","status":"publish","type":"post","link":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved","title":{"rendered":"How can the efficiency of vision transformer AI technology be improved?"},"content":{"rendered":"<p class=\"lead\">Researchers from North Carolina State University have developed a methodology that aims to improve vision transformers\u2019 ability to identify objects in images<\/p>\n<p>A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges.<\/p>\n<p>The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.<\/p>\n<h2 class=\"article-title\">What are vision transformers?<\/h2>\n<p>Transformers are among the most powerful existing AI technology.<\/p>\n<p>ChatGPT, for example, is an AI technology that uses transformer architecture. In this case, the&nbsp;<a href=\"https:\/\/www.innovationnewsnetwork.com\/unlocking-the-potential-of-natural-language-processing-opportunities-and-challenges\/32189\/\" target=\"_blank\" rel=\"noopener\"><strong>inputs used to train it are language<\/strong><\/a>.<\/p>\n<p>Vision transformers are transformer-based AI that are trained using visual inputs.<\/p>\n<p>This AI technology could be used to detect and categorize objects in an image, such as identifying all of the cars in an image.<\/p>\n<h2 class=\"article-title\">Vision transformers face two challenges<\/h2>\n<p>The first challenge faced by ViTs is that transformer models are extremely complex. Transformer models require a significant amount of computational power and use a large amount of memory \u2013 relative to the amount of data being plugged into the AI.<\/p>\n<p>This is problematic for a vision transformer because images contain a lot of data.<\/p>\n<p>The second challenge is that it is difficult for users to understand how ViTs make decisions.<\/p>\n<p>For example, a vision transformer could be trained to identify dogs in an image. It is not entirely clear, however, how the vision transformer is determining what is a dog or not.<\/p>\n<p>Depending on the application, it is important to understand the vision transformer\u2019s decision-making process \u2013 also known as its model interpretability.<\/p>\n<h2 class=\"article-title\">The new vision transformer methodology addresses both challenges<\/h2>\n<p>The new vision transformer methodology developed by the team is called \u2018<a href=\"https:\/\/arxiv.org\/abs\/2203.11987\" target=\"_blank\" rel=\"noopener\"><strong>Patch-to-Cluster attention<\/strong><\/a>\u2019 (PaCa) and improves the efficiency of the AI technology.<\/p>\n<p>\u201cWe address the challenge related to computational and memory demands by using clustering techniques, which allow the transformer architecture to better identify and focus on objects in an image,\u201d said Tianfu Wu, corresponding author of a paper on the work and an associate professor of electrical and computer engineering at North Carolina State University.<\/p>\n<p>\u201cClustering is when the AI lumps sections of the image together, based on similarities it finds in the image data. This significantly reduces computational demands on the system. Before clustering, computational demands for a ViT are quadratic. For example, if the system breaks an image down into 100 smaller units, it would need to compare all 100 units to each other \u2013 which would be 10,000 complex functions.<\/p>\n<p>\u201cBy clustering, we\u2019re able to make this a linear process, where each smaller unit only needs to be compared to a predetermined number of clusters. Let\u2019s say you tell the system to establish ten clusters; that would only be 1,000 complex functions,\u201d Wu said.<\/p>\n<h2 class=\"article-title\">The team completed testing of PaCa<\/h2>\n<p>The researchers extensively tested the new vision transformer methodology by comparing it to two state-of-the-art ViTs called SWin and PVT.<\/p>\n<p>\u201cWe found that PaCa outperformed SWin and PVT in every way,\u201d Wu said.<\/p>\n<p>\u201cPaCa was better at classifying objects in images, better at identifying objects in images, and better at segmentation \u2013 essentially outlining the boundaries of objects in images. It was also more efficient, meaning that it was able to perform those tasks more quickly than the other ViTs.<\/p>\n<p>\u201cThe next step for us is to scale up PaCa by training on larger, foundational data sets.\u201d<\/p>\n<p>Source: <a href=\"https:\/\/www.innovationnewsnetwork.com\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\/33633\/\" target=\"_blank\" rel=\"noopener\">https:\/\/www.innovationnewsnetwork.com\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\/33633\/<\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers from North Carolina State University have developed a methodology that aims to improve vision transformers\u2019 ability to identify objects in images A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a\u2026<\/p>\n","protected":false},"author":2,"featured_media":15488,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_scj_primary_category_id":55,"_scj_featured":false,"_scj_featured_from":"","_scj_featured_until":"","_scj_featured_order":0,"_scj_visibility_class":"current","_scj_layout_family":"standard","_scj_article_style":"","_scj_display_overrides":[],"_scj_intro_image_id":15488,"_scj_intro_alt":"How can the efficiency of vision transformer AI technology be improved?","_scj_intro_caption":"","_scj_intro_class":"","_scj_intro_float":"","_scj_full_image_id":15488,"_scj_full_alt":"How can the efficiency of vision transformer AI technology be improved?","_scj_full_caption":"","_scj_full_class":"","_scj_full_float":"","_scj_media_type":"","_scj_media_provider":"","_scj_media_external_id":"","_scj_media_url":"","_scj_media_poster_id":0,"_scj_media_width":0,"_scj_media_height":0,"_scj_media_aspect_ratio":"","_scj_media_description":"","_scj_gallery_items":[],"_scj_related_post_ids":[],"_scj_additional_authors":[],"scj_layout_family":"standard","scj_media_provider":"","scj_media_url":"","scj_full_caption":"","footnotes":""},"categories":[55],"tags":[],"class_list":["post-15489","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>How can the efficiency of vision transformer AI technology be improved? - thesmartcityjournal.com<\/title>\n<meta name=\"description\" content=\"A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges. The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How can the efficiency of vision transformer AI technology be improved? - thesmartcityjournal.com\" \/>\n<meta property=\"og:description\" content=\"A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges. The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\" \/>\n<meta property=\"og:site_name\" content=\"thesmartcityjournal.com\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/thesmartcityjournal\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-05T04:38:23+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-20T11:17:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2023\/06\/AI_technology.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"697\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Redacci\u00f3n de The Smart City Journal\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SmartCityJour_\" \/>\n<meta name=\"twitter:site\" content=\"@SmartCityJour_\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Redacci\u00f3n de The Smart City Journal\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\"},\"author\":{\"@type\":\"Organization\",\"name\":\"Redacci\u00f3n de The Smart City Journal\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/author\\\/smart-city\"},\"headline\":\"How can the efficiency of vision transformer AI technology be improved?\",\"datePublished\":\"2023-06-05T04:38:23+00:00\",\"dateModified\":\"2025-02-20T11:17:58+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\"},\"wordCount\":593,\"publisher\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/AI_technology.jpg\",\"articleSection\":[\"Artificial Intelligence\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\",\"name\":\"How can the efficiency of vision transformer AI technology be improved? - thesmartcityjournal.com\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/AI_technology.jpg\",\"datePublished\":\"2023-06-05T04:38:23+00:00\",\"dateModified\":\"2025-02-20T11:17:58+00:00\",\"description\":\"A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges. The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/AI_technology.jpg\",\"contentUrl\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/AI_technology.jpg\",\"width\":1200,\"height\":697,\"caption\":\"How can the efficiency of vision transformer AI technology be improved?\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/artificial-intelligence\\\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How can the efficiency of vision transformer AI technology be improved?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#website\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\",\"name\":\"thesmartcityjournal.com\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Organization\",\"NewsMediaOrganization\"],\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#organization\",\"name\":\"thesmartcityjournal.com\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/logo-smart-city-journal-1.png\",\"contentUrl\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/logo-smart-city-journal-1.png\",\"width\":346,\"height\":91,\"caption\":\"thesmartcityjournal.com\"},\"image\":{\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/thesmartcityjournal\",\"https:\\\/\\\/x.com\\\/SmartCityJour_\",\"https:\\\/\\\/www.instagram.com\\\/thesmartcityjournal_\\\/\",\"https:\\\/\\\/www.tiktok.com\\\/@thesmartcityjournal\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/the-smart-city-journal\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCIPTMzK206pVFxMNjO7SSxw\"]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#\\\/schema\\\/person\\\/39c9da1aeac1b5c2d179ef9e4e293cf4\",\"name\":\"Redacci\u00f3n de The Smart City Journal\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/?s=96&d=mm&r=g\",\"caption\":\"Redacci\u00f3n de The Smart City Journal\"},\"description\":\"Equipo de redacci\u00f3n de The Smart City Journal.\",\"url\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en\\\/author\\\/smart-city\"},{\"@type\":\"SiteNavigationElement\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#site-navigation\",\"cssSelector\":[\".cib-main-menu\"]},{\"@type\":\"WPHeader\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#header\",\"cssSelector\":[\".cib-header\"]},{\"@type\":\"WPFooter\",\"@id\":\"https:\\\/\\\/www.thesmartcityjournal.com\\\/en#footer\",\"cssSelector\":[\".cib-footer\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How can the efficiency of vision transformer AI technology be improved? - thesmartcityjournal.com","description":"A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges. The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved","og_locale":"en_US","og_type":"article","og_title":"How can the efficiency of vision transformer AI technology be improved? - thesmartcityjournal.com","og_description":"A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges. The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.","og_url":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved","og_site_name":"thesmartcityjournal.com","article_publisher":"https:\/\/www.facebook.com\/thesmartcityjournal","article_published_time":"2023-06-05T04:38:23+00:00","article_modified_time":"2025-02-20T11:17:58+00:00","og_image":[{"width":1200,"height":697,"url":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2023\/06\/AI_technology.jpg","type":"image\/jpeg"}],"author":"Redacci\u00f3n de The Smart City Journal","twitter_card":"summary_large_image","twitter_creator":"@SmartCityJour_","twitter_site":"@SmartCityJour_","twitter_misc":{"Written by":"Redacci\u00f3n de The Smart City Journal","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#article","isPartOf":{"@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved"},"author":{"@type":"Organization","name":"Redacci\u00f3n de The Smart City Journal","url":"https:\/\/www.thesmartcityjournal.com\/en\/author\/smart-city"},"headline":"How can the efficiency of vision transformer AI technology be improved?","datePublished":"2023-06-05T04:38:23+00:00","dateModified":"2025-02-20T11:17:58+00:00","mainEntityOfPage":{"@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved"},"wordCount":593,"publisher":{"@id":"https:\/\/www.thesmartcityjournal.com\/en#organization"},"image":{"@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage"},"thumbnailUrl":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2023\/06\/AI_technology.jpg","articleSection":["Artificial Intelligence"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved","url":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved","name":"How can the efficiency of vision transformer AI technology be improved? - thesmartcityjournal.com","isPartOf":{"@id":"https:\/\/www.thesmartcityjournal.com\/en#website"},"primaryImageOfPage":{"@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage"},"image":{"@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage"},"thumbnailUrl":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2023\/06\/AI_technology.jpg","datePublished":"2023-06-05T04:38:23+00:00","dateModified":"2025-02-20T11:17:58+00:00","description":"A vision transformer (ViT) is an AI technology that can identify and categorize objects in images. However, there are significant challenges related to decision-making transparency and computing requirements. Now, researchers have developed a new methodology that addresses both of these challenges. The method also improves the ability of a vision transformer to identify, classify, and segment objects in images.","breadcrumb":{"@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#primaryimage","url":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2023\/06\/AI_technology.jpg","contentUrl":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2023\/06\/AI_technology.jpg","width":1200,"height":697,"caption":"How can the efficiency of vision transformer AI technology be improved?"},{"@type":"BreadcrumbList","@id":"https:\/\/www.thesmartcityjournal.com\/en\/artificial-intelligence\/how-can-the-efficiency-of-vision-transformer-ai-technology-be-improved#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.thesmartcityjournal.com\/en"},{"@type":"ListItem","position":2,"name":"How can the efficiency of vision transformer AI technology be improved?"}]},{"@type":"WebSite","@id":"https:\/\/www.thesmartcityjournal.com\/en#website","url":"https:\/\/www.thesmartcityjournal.com\/en","name":"thesmartcityjournal.com","description":"","publisher":{"@id":"https:\/\/www.thesmartcityjournal.com\/en#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.thesmartcityjournal.com\/en?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Organization","NewsMediaOrganization"],"@id":"https:\/\/www.thesmartcityjournal.com\/en#organization","name":"thesmartcityjournal.com","url":"https:\/\/www.thesmartcityjournal.com\/en","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.thesmartcityjournal.com\/en#\/schema\/logo\/image\/","url":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2026\/09\/logo-smart-city-journal-1.png","contentUrl":"https:\/\/www.thesmartcityjournal.com\/wp-content\/uploads\/2026\/09\/logo-smart-city-journal-1.png","width":346,"height":91,"caption":"thesmartcityjournal.com"},"image":{"@id":"https:\/\/www.thesmartcityjournal.com\/en#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/thesmartcityjournal","https:\/\/x.com\/SmartCityJour_","https:\/\/www.instagram.com\/thesmartcityjournal_\/","https:\/\/www.tiktok.com\/@thesmartcityjournal","https:\/\/www.linkedin.com\/company\/the-smart-city-journal\/","https:\/\/www.youtube.com\/channel\/UCIPTMzK206pVFxMNjO7SSxw"]},{"@type":"Organization","@id":"https:\/\/www.thesmartcityjournal.com\/en#\/schema\/person\/39c9da1aeac1b5c2d179ef9e4e293cf4","name":"Redacci\u00f3n de The Smart City Journal","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","caption":"Redacci\u00f3n de The Smart City Journal"},"description":"Equipo de redacci\u00f3n de The Smart City Journal.","url":"https:\/\/www.thesmartcityjournal.com\/en\/author\/smart-city"},{"@type":"SiteNavigationElement","@id":"https:\/\/www.thesmartcityjournal.com\/en#site-navigation","cssSelector":[".cib-main-menu"]},{"@type":"WPHeader","@id":"https:\/\/www.thesmartcityjournal.com\/en#header","cssSelector":[".cib-header"]},{"@type":"WPFooter","@id":"https:\/\/www.thesmartcityjournal.com\/en#footer","cssSelector":[".cib-footer"]}]}},"_links":{"self":[{"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/posts\/15489","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/comments?post=15489"}],"version-history":[{"count":0,"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/posts\/15489\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/media\/15488"}],"wp:attachment":[{"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/media?parent=15489"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/categories?post=15489"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thesmartcityjournal.com\/en\/wp-json\/wp\/v2\/tags?post=15489"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}