HNHacker News
TopNewBestAskShowJobs

lukehollis

1,438 karma · joined May 1, 2020

3d graphics, engineer, founder, boxer https://github.com/lukehollis/ lukehollis@gmail.com
submissionscomments
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Thanks so much!
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Hey, yeah that was me. I spent quite a bit of time last year using pre-existing scanner positions to train nerfs/splats and didn't get anything that was usable, unfortunately. I ended up shifting to Unreal for a higher graphics tier, so if you want to see the Great Pyramid of Giza interior in the highest quality level, you can here: https://mused.com/netherworld-ancient-egyptian-afterlife-sim...

For Unreal I used a few methods but mostly conventional photogrammetry incorporating the lidar.

Ultimately, I'm hoping that downloading the file or some type of pixel streaming for web until the nerfs or splats -- or whatever follows them -- works out.

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
It's something we have to be careful of while working on site! We're really careful around the rooms that have mercury in them--there are few that I didn't put in the guide also.

I was wondering about this too: they've found high levels of mercury in the water supply at Maya cities and believe now it contributed to the eventual collapse: https://arstechnica.com/science/2020/06/mercury-and-algal-bl...

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
You can download or test the Unreal version pixel streaming here: https://mused.com/netherworld-ancient-egyptian-afterlife-sim...

Or here's the trailer for the project in Unreal: https://www.youtube.com/watch?v=hlNgpG9X7mc

I have a lot of work keeping up with games, it's true--games are expensive to build and aiming at photorealism art style continually looks dated quickly while stylized graphics, less so. I'm trying to fundraise to build this game currently, but it's a tough sell. Educational games don't do well on Steam, so right now, I'm just distributing through my website as I build. The small income this provides helps me contribute back to the modern Egyptian Egyptologists that are excavating and documenting their own culture though.

The latest Game Science title, Black Myth Wukong, does an awesome job with 3d captures of Chinese monuments and bringing the mythology and history to life.

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Hey I'm really sorry! It's really hard. My photo permissions at Giza took two years to secure. My only advice is to keep showing up in person and hang in there--I feel for you!
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
100%! Eventually, one way or another, I think they'll be scanned every year to study the environmental effects of tourism and compare over time.
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Haha, yeah I know what you mean. I had to do the exterior with the BLK for only a few hours each morning before it overheated.

That's an impressive huge capture!

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
You should be able to do this with nerfstudio: https://github.com/nerfstudio-project/nerfstudio/ I've done it a few times, you can test 3d Gaussian Splatting also instead.
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Onsite I used the Matterport capture app and Matterport Pro 2 and BLK 360. For the web version linked here, I built on top of the Matterport SDK with Three.js https://matterport.github.io/showcase-sdk/sdkbundle_home.htm...

So in the virtual tour, you're seeing 360 imagery from the cameras and a lower resolution version of the 3d capture data, optimized for web. The lower res mesh from the scanner is transparent in first-person view mode so users get cursor effects on top of the 360 image.

For film, PBS sent out a documentary crew, and they wanted me to render some footage of the full tunnel system, so I exported the e57 pointcloud data from Matterport and rendered the clips they needed in Unreal. It should be coming out soon with "In the Americas."

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Thanks, and I was still on Pro 2 + BLK 360 unfortunately. Haha, thankfully all the cameras survived and made it home, just muddier.
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Thanks!
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
I love the inscriptions too--the stela only get more meaningful the more you learn about them. But it's kind of like Egypt, the iconography is harder to understand because we inherited from a different culture.

For me, the Maya have always been important because they're our history and our stories in the Americas (I'm from the US) -- more than the greco-roman mythology I grew up with. They grew corn and love ball games. Their stories are more directly our stories, and their struggles are our struggles.

Not to be political, but they also kind of wiped themselves out by large scale environmental collapse, and the jungle is filled with their undiscovered monuments. There's still so much to learn.

People really geek out on how much the Maya knew about astronomy too -- they shot archaeoastronomy docs twice while I was working on site. Richard Feynman even helped decipher Maya glyphs and writes about it in "Surely you're joking Mr Feynman". He gave a lecture also if the audio file can be checked out somehow: https://collections.archives.caltech.edu/repositories/2/acce...

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
These look great! What strategy did you use to do the transitions?
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
It is so hard! The long tunnel sections were the worst, but thankfully most of them had multiple join points, like in the Temple 16 / Rosalila temple excavations.
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Wow, thanks so much! I don't recognize your un, who is this? But thanks again!
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Matterport's SDK is so good -- I'm so impressed with the details like mobile performance the more time I spend building with it.

I did take some scans after the collapse! After we'd dug ourselves out and crawled out on our bellies, I went back with Polycam. The collapsed section we dug through was comparatively small, maybe 4-5 meters: Section 1: https://poly.cam/capture/4BB863F2-1CC3-46E3-8BDB-232EE3057BD...? (you can see where we crawled out to the intersection here -- the whole intersection had ceiling collapse, but only the section we dug out through was fully covered). Section 2: https://poly.cam/capture/3C5BB7BD-5FC9-4C00-AE1C-84E0544C51C...

We're just lucky it wasn't a rocky ceiling that fell, that would've been much worse.

The team taking care of the tunnels is doing an amazing job with the resources they have, and they're continually backfilling tunnels now and maintaining the ones that are there. It took us about an hour to dig out.

You can compare to the intersection in the matterport version in the same vicinity: https://my.matterport.com/show/?m=r5BR6K6Qxix&ss=338&sr=-.21...

I don't want to editorialize too much, but at that moment we were totally brothers--I was still early with Spanish, and the language, country, age differences fell away, and we dug ourselves out.

lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Matterport works special magic on the transition between 360 images in their SDK. As far as I understand it, they render 360 cube camera onto the material of the mesh of the environment as you move so it looks like you're moving in the real mesh but only seeing the 360 image. I tried to approximate this myself in Three.js but didn't get anywhere near the quality or performance of their work. Homage.
lukehollis··on Show HN: I 3D scanned the tunnels inside the Maya Pyramid Temples at Copan
Thanks for visiting! It was so many tunnels.. I feel bad that I don't build faster sometimes, but this took awhile.
lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
Sounds great! I'll build this starting with 12 monuments that I've scanned in Egypt.
lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
It's challenging work! Especially in the tunnels at other sites.. But for this scan specifically, I didn't use a tripod, and I edited myself out at the bottom of every 360 photo.

For terrestrial lidar, you can avoid the laser and cameras by following a circular path opposite the device sensors or hide behind a rock or tunnel corner, etc.

lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
Thanks for letting me know, I'll work on performance and memory optimizations. I was developing on Brave.

I used an iPhone 15 and Insta360 one rs with the Leica lenses -- without tripod. I actually went through and edited the humans (including myself) out of every shot, but you can see where I missed some. I'm hoping to go back through and fix them. I put up other tours on the website just from 360 video, and they're much less edited, so I'm still hiding at the bottom of most of the shots until I can edit myself out.

lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
As a follow-up, I used the Polycam app and an iPhone 15 without tripod to capture the majority of imagery in the tour. You can see the iPhone Lidar capture as dollhouse matched with insta360 photos for the virtual tour. The museum photogrammetry was also completed with Polycam.

I aligned the 360 images with Metashape, exported the cameras.xml file with camera transforms/rotations, and converted these to my own json format with a simple 360 virtual tour viewer that I created w/Three.js.

For navigating between tour points, to try to approximate a similar motion affect as Matterport and Google Streetview, I somewhat unsuccessfully project the output of a cubecamera as a rendertexture on the dollhouse lidar of the tomb. I'm not happy with its current state but had to keep moving forward, and I appreciate much more the engineering that went into Matterport's Showcase frontend especially.

lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
That always bugged me too! And just in general I wanted to understand more of what the wall paintings in the tourist path in the Valley of the Kings and Queens were. Having "scenes from religion" or this or that book is way too vague. It's a lot of research reading Netherworld texts and finding their corresponding scene on the tomb walls to write these tours.
lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
That's a great idea! I'm working on this in the pyramid of unas with an Egyptologist. Sometimes that granularity of information is still hard to track down.
lukehollis··on Show HN: The Tomb of Nefertari [QV 66] Guided Virtual Tour
Thanks, good to know -- that's something I can change
lukehollis··on Ask HN: Top 10 Timeless Software Books That ChangedLife as Software Engineer?
For me, "Hackers and Painters," by far.
lukehollis··on Gsplat: CUDA accelerated rasterization of gaussians with Python bindings
Something close to what you mention is dynamic scene capture, such as this paper: https://dynamic3dgaussians.github.io/

You can manipulate the splats in viewer, kind of similar to a pointcloud, something to the effect of https://twitter.com/parazar/status/1713618668788109357 but there are a bunch around social media.

This has an entrypoint to the research and various projects so far: https://github.com/MrNeRF/awesome-3D-gaussian-splatting

lukehollis··on Show HN: The Tomb of Ramesses I in the Valley of the Kings
Thanks so much for mentioning this--I always wanted this too while I work at these sites! This tour took so many hours staring at Netherworld snakes reading the Book of the Gates, but there's so much more that could be added about the wall paintings.

The Time snake in the depths in the Netherworld still mystifies me.. and the Barque of the Earth! Wonders. OsirisNet has good interpretations for going deeper: https://osirisnet.net/tombes/pharaons/ramses1/e_ramses1_01.h...

And the Darnell's Netherworld Books book is awesome: https://www.amazon.com/Ancient-Egyptian-Netherworld-Books-Wr...

Or for audio, Dominic Perry's amazing podcast with the 2 part narration of the Book of Gates: https://www.egyptianhistorypodcast.com/175-in-the-hall-of-th...

AR in these tombs would be amazing!

lukehollis··on Show HN: The Tomb of Ramesses I in the Valley of the Kings
Thanks so much for the feedback! I added godrays and stars to the Netherworld scenes, turned off the dust, and made other improvements for rendering. I ended up switching from three's default renderer to the postprocessing package.

I also added a light bulb button to the top too to toggle the lights and guided mode.

lukehollis··on Show HN: The Tomb of Ramesses I in the Valley of the Kings
That's so cool--and it's interesting to see how the 360 image tours have evolved over the years. I'm hoping gaussian splatting or nerfs will do better soon. You could try your photos in nerfstudio and see what type of results you're able to get: https://github.com/nerfstudio-project

Threejs has been great to work with. It's pretty simple orbitcontrols but the occluders on the dollhouse for the cursor in first-person view are a little more complex. I hope to share the codebase, but it's definitely still a sketch instead of the full picture--right now with a lot of adhoc parts for this specific tour for the vfx.

← PreviousPage 2 of 5Next →