{"id":356,"date":"2024-12-23T03:03:53","date_gmt":"2024-12-23T03:03:53","guid":{"rendered":"https:\/\/e-muse.it\/blog\/?p=356"},"modified":"2024-12-23T03:03:53","modified_gmt":"2024-12-23T03:03:53","slug":"new-mesh-reduction-tools","status":"publish","type":"post","link":"https:\/\/e-muse.it\/blog\/2024\/12\/23\/new-mesh-reduction-tools\/","title":{"rendered":"New mesh reduction tools"},"content":{"rendered":"\n

Holo Lab released this new Blender add-on that does a pretty job at reducing most photogrammetry models: https:\/\/github.com\/HoloLabInc\/ModerateWeightReductionTools<\/a><\/p>\n\n\n\n

It does fail on the more topologically challenged ones, but that is to be expected. As an example this 25MB model:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Was reduced to this, which is just 295kB.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

I did remove the black background by hand, though.<\/p>\n\n\n\n

The interesting thing is that it added Sharps to edges automatically, you can see them in cyan.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Of course the other interesting announcements in this field were Nvidia’s Meshtron<\/a> and Microsoft’s Trellis<\/a> (try it on hugginface<\/a>), both of which do really interesting mesh generation.<\/p>\n\n\n\n

Of course for our requirements we cannot simply throw generative AI at the problem and hope for the best, we need to carefully represent the actual objects. But just as a try, we did try to throw an image of a bas-relief at Trellis. It created a plausible (but incorrect) result with a low-res texture. We tried throwing the original image on it as a texture, and it almost looked like it worked, until we tried moving the point of view.<\/p>\n\n\n\n

This is the original photo, it’s Il Lavoro by Pietro Palmisano<\/a>, from the BCC Arte & Cultura<\/a> catalogue.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Generated model, with no texture:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

With the AI-generated texture<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

With the original texture applied:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

It’s simultaneously very impressive, and not any good.<\/strong> We could try to salvage it by sculpting the most egregious parts, and we could do way better on the texture mapping.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The geometry is really quite dense, we could try combining Trellis with Moderate Weight Reduction Tools.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

That really broke down. The geometry became visibly spiky, but the texture is just all wrong, it did not expect our “Project from View” trick.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Holo Lab released this new Blender add-on that does a pretty job at reducing most photogrammetry models: https:\/\/github.com\/HoloLabInc\/ModerateWeightReductionTools It does fail on the more topologically challenged ones, but that is to be expected. As an example this 25MB model: Was reduced to this, which is just 295kB. I did remove the black background by hand, […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":3,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"federate","footnotes":""},"categories":[5,27],"tags":[29,45,31,6,37,33],"class_list":["post-356","post","type-post","status-publish","format-standard","hentry","category-reconstruction","category-tools","tag-ai","tag-blender","tag-open-source","tag-photogrammetry","tag-spatial","tag-til"],"_links":{"self":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts\/356","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/comments?post=356"}],"version-history":[{"count":1,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts\/356\/revisions"}],"predecessor-version":[{"id":369,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts\/356\/revisions\/369"}],"wp:attachment":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/media?parent=356"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/categories?post=356"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/tags?post=356"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}