threepipe
Du kannst nicht mehr als 25 Themen auswählen Themen müssen mit entweder einem Buchstaben oder einer Ziffer beginnen. Sie können Bindestriche („-“) enthalten und bis zu 35 Zeichen lang sein.

vor 2 Jahren
vor 2 Jahren
vor 2 Jahren
vor 2 Jahren
vor 2 Jahren
vor 2 Jahren
vor 2 Jahren
vor 2 Jahren
12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091929394959697989910010110210310410510610710810911011111211311411511611711811912012112212312412512612712812913013113213313413513613713813914014114214314414514614714814915015115215315415515615715815916016116216316416516616716816917017117217317417517617717817918018118218318418518618718818919019119219319419519619719819920020120220320420520620720820921021121221321421521621721821922022122222322422522622722822923023123223323423523623723823924024124224324424524624724824925025125225325425525625725825926026126226326426526626726826927027127227327427527627727827928028128228328428528628728828929029129229329429529629729829930030130230330430530630730830931031131231331431531631731831932032132232332432532632732832933033133233333433533633733833934034134234334434534634734834935035135235335435535635735835936036136236336436536636736836937037137237337437537637737837938038138238338438538638738838939039139239339439539639739839940040140240340440540640740840941041141241341441541641741841942042142242342442542642742842943043143243343443543643743843944044144244344444544644744844945045145245345445545645745845946046146246346446546646746846947047147247347447547647747847948048148248348448548648748848949049149249349449549649749849950050150250350450550650750850951051151251351451551651751851952052152252352452552652752852953053153253353453553653753853954054154254354454554654754854955055155255355455555655755855956056156256356456556656756856957057157257357457557657757857958058158258358458558658758858959059159259359459559659759859960060160260360460560660760860961061161261361461561661761861962062162262362462562662762862963063163263363463563663763863964064164264364464564664764864965065165265365465565665765865966066166266366466566666766866967067167267367467567667767867968068168268368468568668768868969069169269369469569669769869970070170270370470570670770870971071171271371471571671771871972072172272372472572672772872973073173273373473573673773873974074174274374474574674774874975075175275375475575675775875976076176276376476576676776876977077177277377477577677777877978078178278378478578678778878979079179279379479579679779879980080180280380480580680780880981081181281381481581681781881982082182282382482582682782882983083183283383483583683783883984084184284384484584684784884985085185285385485585685785885986086186286386486586686786886987087187287387487587687787887988088188288388488588688788888989089189289389489589689789889990090190290390490590690790890991091191291391491591691791891992092192292392492592692792892993093193293393493593693793893994094194294394494594694794894995095195295395495595695795895996096196296396496596696796896997097197297397497597697797897998098198298398498598698798898999099199299399499599699799899910001001100210031004100510061007100810091010101110121013101410151016101710181019102010211022102310241025102610271028102910301031103210331034103510361037103810391040104110421043104410451046104710481049105010511052105310541055105610571058105910601061106210631064106510661067106810691070107110721073107410751076107710781079108010811082108310841085108610871088108910901091109210931094109510961097109810991100110111021103110411051106110711081109111011111112111311141115111611171118111911201121112211231124112511261127112811291130113111321133113411351136113711381139114011411142114311441145114611471148114911501151115211531154115511561157115811591160116111621163116411651166116711681169117011711172117311741175117611771178117911801181118211831184118511861187118811891190119111921193119411951196119711981199120012011202120312041205120612071208120912101211121212131214121512161217121812191220122112221223122412251226122712281229123012311232123312341235123612371238123912401241124212431244124512461247124812491250125112521253125412551256125712581259126012611262126312641265126612671268126912701271127212731274127512761277127812791280128112821283128412851286128712881289129012911292129312941295129612971298129913001301130213031304130513061307130813091310131113121313131413151316131713181319132013211322132313241325132613271328132913301331133213331334133513361337133813391340134113421343134413451346134713481349135013511352135313541355135613571358135913601361136213631364136513661367136813691370137113721373137413751376137713781379138013811382138313841385138613871388138913901391139213931394139513961397139813991400140114021403140414051406140714081409141014111412141314141415141614171418141914201421142214231424142514261427142814291430143114321433143414351436143714381439144014411442144314441445144614471448144914501451145214531454145514561457145814591460146114621463146414651466146714681469147014711472147314741475147614771478147914801481148214831484148514861487148814891490149114921493149414951496149714981499150015011502150315041505150615071508150915101511151215131514151515161517151815191520152115221523152415251526152715281529153015311532153315341535153615371538153915401541154215431544154515461547154815491550155115521553155415551556155715581559156015611562156315641565156615671568156915701571157215731574157515761577157815791580158115821583158415851586158715881589159015911592159315941595159615971598159916001601160216031604160516061607160816091610161116121613161416151616161716181619162016211622162316241625162616271628162916301631163216331634163516361637163816391640164116421643164416451646164716481649165016511652165316541655165616571658165916601661166216631664166516661667166816691670167116721673167416751676167716781679168016811682168316841685168616871688168916901691169216931694169516961697169816991700170117021703170417051706170717081709171017111712171317141715171617171718171917201721172217231724172517261727172817291730173117321733173417351736173717381739174017411742174317441745174617471748174917501751175217531754175517561757175817591760176117621763176417651766176717681769177017711772177317741775177617771778177917801781178217831784178517861787178817891790179117921793179417951796179717981799180018011802180318041805180618071808180918101811181218131814181518161817181818191820182118221823182418251826182718281829183018311832183318341835183618371838183918401841184218431844184518461847184818491850185118521853185418551856185718581859186018611862186318641865186618671868186918701871187218731874187518761877187818791880188118821883188418851886188718881889189018911892189318941895189618971898189919001901190219031904190519061907190819091910191119121913191419151916191719181919192019211922192319241925192619271928192919301931193219331934193519361937193819391940194119421943194419451946194719481949195019511952195319541955195619571958195919601961196219631964196519661967196819691970197119721973197419751976197719781979198019811982198319841985198619871988198919901991199219931994199519961997199819992000200120022003200420052006200720082009201020112012201320142015201620172018201920202021202220232024202520262027202820292030203120322033203420352036203720382039204020412042204320442045204620472048204920502051205220532054205520562057205820592060206120622063206420652066206720682069207020712072207320742075207620772078207920802081208220832084208520862087208820892090209120922093209420952096209720982099210021012102210321042105210621072108210921102111211221132114211521162117211821192120212121222123212421252126212721282129213021312132213321342135213621372138213921402141214221432144214521462147214821492150215121522153215421552156215721582159216021612162216321642165216621672168216921702171217221732174217521762177217821792180218121822183218421852186218721882189219021912192219321942195219621972198219922002201220222032204220522062207220822092210221122122213221422152216221722182219222022212222222322242225222622272228222922302231223222332234223522362237223822392240224122422243224422452246224722482249225022512252225322542255225622572258225922602261226222632264226522662267226822692270227122722273227422752276227722782279228022812282228322842285228622872288228922902291229222932294229522962297229822992300230123022303230423052306230723082309231023112312231323142315231623172318231923202321232223232324232523262327232823292330233123322333233423352336233723382339234023412342234323442345234623472348234923502351235223532354235523562357235823592360236123622363236423652366236723682369237023712372237323742375237623772378237923802381238223832384238523862387238823892390239123922393239423952396239723982399240024012402240324042405240624072408240924102411241224132414241524162417241824192420242124222423242424252426242724282429243024312432243324342435243624372438243924402441244224432444244524462447244824492450245124522453245424552456245724582459246024612462246324642465246624672468246924702471247224732474247524762477247824792480248124822483248424852486248724882489249024912492249324942495249624972498249925002501250225032504250525062507250825092510251125122513251425152516251725182519252025212522252325242525252625272528252925302531253225332534253525362537253825392540254125422543254425452546254725482549255025512552255325542555255625572558255925602561256225632564256525662567256825692570257125722573257425752576257725782579258025812582258325842585258625872588258925902591259225932594259525962597259825992600260126022603260426052606260726082609261026112612261326142615261626172618261926202621262226232624262526262627262826292630263126322633263426352636263726382639264026412642264326442645264626472648264926502651265226532654265526562657265826592660266126622663266426652666266726682669267026712672267326742675267626772678267926802681268226832684268526862687268826892690269126922693269426952696269726982699270027012702270327042705270627072708270927102711271227132714271527162717271827192720272127222723272427252726272727282729273027312732273327342735273627372738273927402741274227432744274527462747274827492750275127522753275427552756275727582759276027612762276327642765276627672768276927702771277227732774277527762777277827792780278127822783278427852786278727882789279027912792279327942795279627972798279928002801280228032804280528062807280828092810281128122813281428152816281728182819282028212822282328242825282628272828282928302831283228332834283528362837283828392840284128422843284428452846284728482849285028512852285328542855285628572858285928602861286228632864286528662867286828692870287128722873287428752876287728782879288028812882288328842885288628872888288928902891289228932894289528962897289828992900290129022903290429052906290729082909291029112912291329142915291629172918291929202921292229232924292529262927292829292930293129322933293429352936293729382939294029412942294329442945294629472948294929502951295229532954295529562957295829592960296129622963296429652966296729682969297029712972297329742975297629772978297929802981298229832984298529862987298829892990299129922993299429952996299729982999300030013002300330043005300630073008300930103011301230133014301530163017301830193020302130223023302430253026302730283029303030313032303330343035303630373038303930403041304230433044304530463047304830493050305130523053305430553056305730583059306030613062306330643065306630673068306930703071307230733074307530763077307830793080308130823083308430853086308730883089309030913092309330943095309630973098309931003101310231033104310531063107310831093110311131123113311431153116311731183119312031213122312331243125312631273128312931303131313231333134313531363137313831393140314131423143314431453146314731483149315031513152315331543155
  1. # ThreePipe
  2. A new way to work with three.js, 3D models and rendering on the web.
  3. [ThreePipe](https://threepipe.org/) —
  4. [Github](https://github.com/repalash/threepipe) —
  5. [Examples](https://threepipe.org/examples/) —
  6. [API Reference](https://threepipe.org/docs/) —
  7. [WebGi](https://webgi.xyz/docs/)
  8. [![NPM Package](https://img.shields.io/npm/v/threepipe.svg)](https://www.npmjs.com/package/threepipe)
  9. [![Discord Server](https://img.shields.io/discord/956788102473584660?label=Discord&logo=discord)](https://discord.gg/apzU8rUWxY)
  10. [![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-green.svg)](https://opensource.org/license/apache-2-0/)
  11. [![Twitter](https://img.shields.io/twitter/url/https/twitter.com/repalash.svg?style=social&label=Follow%20%40repalash)](https://twitter.com/repalash)
  12. ThreePipe is a 3D framework built on top of [three.js](https://threejs.org/) in TypeScript with a focus on rendering quality, modularity, and extensibility.
  13. Key features include:
  14. - Simple, intuitive API for creating 3D model viewers/configurators/editors on web pages, with many built-in presets for common workflows and use-cases.
  15. - Companion [editor](https://threepipe.org/examples/tweakpane-editor/) to create, edit and configure 3D scenes in the browser.
  16. - Modular architecture that allows you to easily extend the viewer, scene objects, materials, shaders, rendering, post-processing and serialization with custom functionality.
  17. - Plugin system along with a rich library of built-in plugins that allows you to easily add new features to the viewer.
  18. - [uiconfig](https://github.com/repalash/uiconfig.js) compatibility to automatically generate configuration UIs in the browser.
  19. - Modular rendering pipeline with built-in deferred rendering, post-processing, RGBM HDR rendering, etc.
  20. - Material extension framework to modify/inject/build custom shader code into existing materials at runtime from plugins.
  21. - Extendable asset import, export and management pipeline with built-in support for gltf, glb, obj+mtl, fbx, materials(pmat/bmat), json, zip, png, jpeg, svg, webp, ktx2, ply, 3dm and many more.
  22. - Automatic serialization of all viewer and plugin settings in GLB(with custom extensions) and JSON formats.
  23. - Automatic disposal of all three.js resources with built-in reference management.
  24. ## Examples
  25. Code samples and demos covering various usecases and test are present in the [examples](./examples/) folder.
  26. Try them: https://threepipe.org/examples/
  27. View the source code by pressing the code button on the top left of the example page.
  28. To make changes and run the example, click on the CodePen button on the top right of the source code.
  29. ## Table of Contents
  30. - [ThreePipe](#threepipe)
  31. - [Examples](https://threepipe.org/examples/)
  32. - [Table of Contents](#table-of-contents)
  33. - [Getting Started](#getting-started)
  34. - [HTML/JS Quickstart (CDN)](#htmljs-quickstart-cdn)
  35. - [React](#react)
  36. - [Vue.js](#vuejs)
  37. - [Svelte](#svelte)
  38. - [NPM/YARN Package](#npmyarn)
  39. - [Installation](#installation)
  40. - [Loading a 3D Model](#loading-a-3d-model)
  41. - [License](#license)
  42. - [Status](#status)
  43. - [Documentation (API Reference)](#documentation)
  44. - [WebGi](#webgi)
  45. - [Contributing](#contributing)
  46. - [Features](#features)
  47. - [File Formats](#file-formats)
  48. - [Loading files](#loading-files)
  49. - [3D models](#3d-models)
  50. - [Materials](#materials)
  51. - [Images/Textures](#imagestextures)
  52. - [zip files](#zip-files)
  53. - [txt, json files](#txt-json-files)
  54. - [Data URLs](#data-urls)
  55. - [Local files, File and Blob](#local-files-file-and-blob)
  56. - [Background, Environment maps](#background-environment-maps)
  57. - [SVG strings](#svg-strings)
  58. - [Exporting files](#exporting-files)
  59. - [Exporting 3D models](#exporting-3d-models)
  60. - [Exporting Materials](#exporting-materials)
  61. - [Exporting Canvas Images](#exporting-canvas-images)
  62. - [Exporting Images/Textures](#exporting-imagestextures)
  63. - [Exporting Render Targets](#exporting-render-targets)
  64. - [Render Pipeline](#render-pipeline)
  65. - [Material Extension](#material-extension)
  66. - [UI Configuration](#ui-configuration)
  67. - [Serialization](#serialization)
  68. - [Plugin System](#plugin-system)
  69. - [Viewer API](#viewer-api)
  70. - [ThreeViewer](#threeviewer)
  71. - [RenderManager](#rendermanager)
  72. - [RootScene](#rootscene)
  73. - [ICamera](#icamera)
  74. - [AssetManager](#assetmanager)
  75. - [AssetImporter](#assetimporter)
  76. - [AssetExporter](#assetexporter)
  77. - [MaterialManager](#materialmanager)
  78. - [Plugins](#threepipe-plugins)
  79. - [TonemapPlugin](#tonemapplugin) - Add tonemap to the final screen pass
  80. - [DropzonePlugin](#dropzoneplugin) - Drag and drop local files to import and load
  81. - [ProgressivePlugin](#progressiveplugin) - Post-render pass to blend the last frame with the current frame
  82. - [DepthBufferPlugin](#depthbufferplugin) - Pre-rendering of depth buffer
  83. - [NormalBufferPlugin](#normalbufferplugin) - Pre-rendering of normal buffer
  84. - [GBufferPlugin](#depthnormalbufferplugin) - Pre-rendering of depth and normal buffers in a single pass buffer
  85. - [PickingPlugin](#pickingplugin) - Adds support for selecting objects in the viewer with user interactions and selection widgets
  86. - [TransformControlsPlugin](#transformcontrolsplugin) - Adds support for moving, rotating and scaling objects in the viewer with interactive widgets
  87. - [GLTFAnimationPlugin](#gltfanimationplugin) - Add support for playing and seeking gltf animations
  88. - [PopmotionPlugin](#popmotionplugin) - Integrates with popmotion.io library for animation/tweening
  89. - [CameraViewPlugin](#cameraviewplugin) - Add support for saving, loading, animating, looping between camera views
  90. - [RenderTargetPreviewPlugin](#rendertargetpreviewplugin) - Preview any render target in a UI panel over the canvas
  91. - [GeometryUVPreviewPlugin](#geometryuvpreviewplugin) - Preview UVs of any geometry in a UI panel over the canvas
  92. - [FrameFadePlugin](#framefadeplugin) - Post-render pass to smoothly fade to a new rendered frame over time
  93. - [VignettePlugin](#vignetteplugin) - Add Vignette effect by patching the final screen pass
  94. - [ChromaticAberrationPlugin](#chromaticaberrationplugin) - Add Chromatic Aberration effect by patching the final screen pass
  95. - [FilmicGrainPlugin](#filmicgrainplugin) - Add Filmic Grain effect by patching the final screen pass
  96. - [NoiseBumpMaterialPlugin](#noisebumpmaterialplugin) - Sparkle Bump/Noise Bump material extension for PhysicalMaterial
  97. - [CustomBumpMapPlugin](#custombumpmapplugin) - Custom Bump Map material extension for PhysicalMaterial
  98. - [ClearcoatTintPlugin](#clearcoattintplugin) - Clearcoat Tint material extension for PhysicalMaterial
  99. - [FragmentClippingExtensionPlugin](#fragmentclippingextensionplugin) - Fragment/SDF Clipping material extension for PhysicalMaterial
  100. - [HDRiGroundPlugin](#hdrigroundplugin) - Add support for ground projected hdri/skybox to the webgl background shader.
  101. - [VirtualCamerasPlugin](#virtualcamerasplugin) - Add support for rendering virtual cameras before the main one every frame.
  102. - [EditorViewWidgetPlugin](#editorviewwidgetplugin) - Adds an interactive ViewHelper/AxisHelper that syncs with the main camera.
  103. - [Rhino3dmLoadPlugin](#rhino3dmloadplugin) - Add support for loading .3dm files
  104. - [PLYLoadPlugin](#plyloadplugin) - Add support for loading .ply files
  105. - [STLLoadPlugin](#stlloadplugin) - Add support for loading .stl files
  106. - [KTX2LoadPlugin](#ktx2loadplugin) - Add support for loading .ktx2 files
  107. - [KTXLoadPlugin](#ktxloadplugin) - Add support for loading .ktx files
  108. - [Packages](#threepipe-packages)
  109. - [@threepipe/plugin-tweakpane](#threepipeplugin-tweakpane) Tweakpane UI Plugin
  110. - [@threepipe/plugin-blueprintjs](#threepipeplugin-blueprintjs) BlueprintJs UI Plugin
  111. - [@threepipe/plugin-tweakpane-editor](#threepipeplugin-tweakpane-editor) - Tweakpane Editor Plugin
  112. - [@threepipe/plugins-extra-importers](#threepipeplugins-extra-importers) - Plugin for loading more file types supported by loaders in three.js
  113. - [@threepipe/plugin-blend-importer](#threepipeplugin-blend-importer) - Blender to add support for loading .blend file
  114. - [@threepipe/plugin-geometry-generator](#threepipeplugin-geometry-generator) - Generate parametric geometry types that can be re-generated from UI/API.
  115. ## Getting Started
  116. ### HTML/JS Quickstart (CDN)
  117. ```html
  118. <canvas id="three-canvas" style="width: 800px; height: 600px;"></canvas>
  119. <script type="module">
  120. import {ThreeViewer, DepthBufferPlugin} from 'https://threepipe.org/dist/index.mjs'
  121. const viewer = new ThreeViewer({canvas: document.getElementById('three-canvas')})
  122. // Add some plugins
  123. viewer.addPluginSync(new DepthBufferPlugin())
  124. // Load an environment map
  125. const envPromise = viewer.setEnvironmentMap('https://threejs.org/examples/textures/equirectangular/venice_sunset_1k.hdr')
  126. const modelPromise = viewer.load('https://threejs.org/examples/models/gltf/DamagedHelmet/glTF/DamagedHelmet.gltf', {
  127. autoCenter: true,
  128. autoScale: true,
  129. })
  130. Promise.all([envPromise, modelPromise]).then(([env, model]) => {
  131. console.log('Loaded', model, env, viewer)
  132. })
  133. </script>
  134. ```
  135. Check it in action: https://threepipe.org/examples/#html-js-sample/
  136. Check out the details about the [ThreeViewer API](#viewer-api) and more [plugins](#threepipe-plugins) below.
  137. ### React
  138. A sample [react](https://react.dev) component in tsx to render a model with an environment map.
  139. ```tsx
  140. import React from 'react'
  141. function ThreeViewerComponent({src, env}: {src: string, env: string}) {
  142. const canvasRef = React.useRef(null)
  143. React.useEffect(() => {
  144. const viewer = new ThreeViewer({canvas: canvasRef.current})
  145. const envPromise = viewer.setEnvironmentMap(env)
  146. const modelPromise = viewer.load(src)
  147. Promise.all([envPromise, modelPromise])
  148. return () => {
  149. viewer.dispose()
  150. }
  151. }, [])
  152. return (
  153. <canvas id="three-canvas" style={{width: 800, height: 600}} ref={canvasRef} />
  154. )
  155. }
  156. ```
  157. Check it in action: https://threepipe.org/examples/#react-tsx-sample/
  158. Other examples in js: https://threepipe.org/examples/#react-js-sample/ and jsx: https://threepipe.org/examples/#react-jsx-sample/
  159. ### Vue.js
  160. A sample [vue.js](https://vuejs.org/) component in js to render a model with an environment map.
  161. ```js
  162. const ThreeViewerComponent = {
  163. setup() {
  164. const canvasRef = ref(null);
  165. onMounted(() => {
  166. const viewer = new ThreeViewer({ canvas: canvasRef.value });
  167. const envPromise = viewer.setEnvironmentMap('https://threejs.org/examples/textures/equirectangular/venice_sunset_1k.hdr');
  168. const modelPromise = viewer.load('https://threejs.org/examples/models/gltf/DamagedHelmet/glTF/DamagedHelmet.gltf');
  169. Promise.all([envPromise, modelPromise])
  170. onBeforeUnmount(() => {
  171. viewer.dispose();
  172. });
  173. });
  174. return { canvasRef };
  175. },
  176. };
  177. ```
  178. Check it in action: https://threepipe.org/examples/#vue-html-sample/
  179. Another example with Vue SFC(Single file component): https://threepipe.org/examples/#vue-sfc-sample/
  180. ### Svelte
  181. A sample [svelte](https://svelte.dev/) component in js to render a model with an environment map.
  182. ```html
  183. <script>
  184. import {onDestroy, onMount} from 'svelte';
  185. import {ThreeViewer} from 'threepipe';
  186. let canvasRef;
  187. let viewer;
  188. onMount(() => {
  189. viewer = new ThreeViewer({canvas: canvasRef});
  190. const envPromise = viewer.setEnvironmentMap('https://threejs.org/examples/textures/equirectangular/venice_sunset_1k.hdr');
  191. const modelPromise = viewer.load('https://threejs.org/examples/models/gltf/DamagedHelmet/glTF/DamagedHelmet.gltf');
  192. Promise.all([envPromise, modelPromise])
  193. });
  194. onDestroy(() => viewer.dispose())
  195. </script>
  196. <canvas bind:this={canvasRef} id="three-canvas" style="width: 800px; height: 600px"></canvas>
  197. ```
  198. Check it in action: https://threepipe.org/examples/#svelte-sample/
  199. ### NPM/YARN
  200. ### Installation
  201. ```bash
  202. npm install threepipe
  203. ```
  204. ### Loading a 3D Model
  205. First, create a canvas element in your HTML page:
  206. ```html
  207. <canvas id="three-canvas" style="width: 800px; height: 600px;"></canvas>
  208. ```
  209. Then, import the viewer and create a new instance:
  210. ```typescript
  211. import {ThreeViewer, IObject3D} from 'threepipe'
  212. // Create a viewer
  213. const viewer = new ThreeViewer({canvas: document.getElementById('three-canvas') as HTMLCanvasElement})
  214. // Load an environment map
  215. await viewer.setEnvironmentMap('https://threejs.org/examples/textures/equirectangular/venice_sunset_1k.hdr')
  216. // Load a model
  217. const result = await viewer.load<IObject3D>('https://threejs.org/examples/models/gltf/DamagedHelmet/glTF/DamagedHelmet.gltf', {
  218. autoCenter: true,
  219. autoScale: true,
  220. })
  221. ```
  222. That's it! You should now see a 3D model on your page.
  223. The 3D model can be opened in the [editor](TODO) to view and edit the scene settings, objects, materials, lights, cameras, post-processing, etc. and exported as a GLB file. All settings are automatically serialized and saved in the GLB file, which can be loaded into the viewer. Any plugins used in the editor can be added to the viewer to add the same functionality. The plugin data is automatically loaded(if the plugin is added) when the model is added to the scene.
  224. The viewer initializes with a Scene, Camera, Camera controls(Orbit Controls), several importers, exporters and a default rendering pipeline. Additional functionality can be added with plugins.
  225. Check out the GLTF Load example to see it in action or to check the JS equivalent code: https://threepipe.org/examples/#gltf-load/
  226. Check out the [Plugins](#plugins) section below to learn how to add additional functionality to the viewer.
  227. ## License
  228. The core framework([src](https://github.com/repalash/threepipe/tree/master/src), [dist](https://github.com/repalash/threepipe/tree/master/dist), [examples](https://github.com/repalash/threepipe/tree/master/examples) folders) and any [plugins](https://github.com/repalash/threepipe/tree/master/plugins) without a separate license are under the Free [Apache 2.0 license](https://github.com/repalash/threepipe/tree/master/LICENSE).
  229. Some plugins(in the [plugins](https://github.com/repalash/threepipe/tree/master/plugins) folder) might have different licenses. Check the individual plugin documentation and the source folder/files for more details.
  230. ## Status
  231. The project is in `alpha` stage and under active development. Many features will be added but the core API will not change significantly in future releases.
  232. Check out [WebGi](https://webgi.xyz/) for an advanced tailor-made solution for e-commerce, jewelry, automobile, apparel, furniture etc.
  233. ## Documentation
  234. Check the list of all functions, classes and types in the [API Reference Docs](https://threepipe.org/docs/).
  235. ## WebGi
  236. Check out WebGi - Premium Photo-realistic 3D rendering framework and tools for web applications and online commerce along with custom modules and rendering solutions for e-commerce, jewelry, automobile, apparel, furniture and other retail applications.
  237. [Homepage](https://webgi.xyz/) &mdash; [Docs](https://webgi.xyz/docs/)
  238. [![Twitter](https://img.shields.io/twitter/url/https/twitter.com/repalash.svg?style=social&label=Follow%20%40pixotronics)](https://twitter.com/pixotronics)
  239. ## Contributing
  240. Contributions to ThreePipe are welcome and encouraged! Feel free to open issues and pull requests on the GitHub repository.
  241. # Features
  242. ## File Formats
  243. ThreePipe Asset Manager supports the import of the following file formats out of the box:
  244. * **Models**: gltf, glb, obj+mtl, fbx, drc
  245. * **Materials**: mat, pmat, bmat (json based), registered material template slugs
  246. * **Images**: webp, png, jpeg, jpg, svg, ico, avif, hdr, exr
  247. * **Misc**: json, vjson, zip, txt
  248. Plugins can add additional formats:
  249. * Models
  250. * 3dm - Using [Rhino3dmLoadPlugin](#Rhino3dmLoadPlugin)
  251. * ply - Using [PLYLoadPlugin](#PLYLoadPlugin)
  252. * usdz - Using [USDZLoadPlugin](#USDZLoadPlugin)
  253. * stl - Using [STLLoadPlugin](#STLLoadPlugin)
  254. * ktx - Using [KTXLoadPlugin](#KTXLoadPlugin)
  255. * ktx2 - Using [KTX2LoadPlugin](#KTX2LoadPlugin)
  256. Plugins to support more model formats are available in the package [@threepipe/plugins-extra-importers](#threepipeplugins-extra-importers) including .3ds,
  257. .3mf, .collada, .amf, .bvh, .vox, .gcode, .mdd, .pcd, .tilt, .wrl, .mpd, .vtk, .xyz
  258. ## Loading files
  259. ThreePipe uses the [AssetManager](https://threepipe.org/docs/classes/AssetManager.html) to load files.
  260. The AssetManager has support for loading files from URLs, local files and data URLs.
  261. The AssetManager also adds support for loading files from a zip archive. The zip files are automatically unzipped, and the files are loaded from the zip archive.
  262. [viewer.load()](https://threepipe.org/docs/classes/ThreeViewer.html#load) is a high-level wrapper for loading files from the AssetManager.
  263. It automatically adds the loaded object to the scene and returns a promise that resolves to the loaded object,
  264. the materials are also automatically registered to the material manager.
  265. AssetManager internally uses [AssetImporter](https://threepipe.org/docs/classes/AssetImporter.html),
  266. which provides a low-level API
  267. for managing three.js [LoadingManager](https://threejs.org/docs/#api/en/loaders/LoadingManager)
  268. and adding and registering loaders for different file types.
  269. If the purpose is not to add files to the scene then [viewer.assetManager.importer.import()](https://threepipe.org/docs/classes/AssetImporter.html#import) method can be used
  270. to import files from the `AssetImporter`.
  271. viewer.assetManager.loadImported()](https://threepipe.org/docs/classes/AssetManager.html#loadImported)
  272. can then be called to load the imported files after any processing.
  273. The `viewer.load()`, `viewer.assetManager.addAsset()`
  274. and `viewer.assetManager.addAssetSingle()` methods perform combination of `import` and `loadImported`.
  275. ### 3D models
  276. The 3d models are added to `viewer.scene.modelRoot` on `viewer.load` unless some option is specified.
  277. ```typescript
  278. const objectGlb = await viewer.load<IObject3D>('https://example.com/file.glb')
  279. const objectFbx = await viewer.load<IObject3D>('https://example.com/file.fbx')
  280. const objectObj = await viewer.load<IObject3D>('https://example.com/file.obj') // .mtl referenced in obj is automatically loaded
  281. // ... load any 3d model file as an object
  282. ```
  283. Here, we are casting to [IObject3D](https://threepipe.org/docs/interfaces/IObject3D.html) type
  284. to get the proper type and autocomplete for the object.
  285. `IObject3D` inherits [Object3D](https://threejs.org/docs/#api/en/core/Object3D) from three.js and adds some additional properties.
  286. For JavaScript, the type can be omitted.
  287. ```javascript
  288. const objectGlb = await viewer.load('https://example.com/file.glb')
  289. ```
  290. When loading models, several options can be passed to automatically process the model first time, like `autoScale`, `autoCenter`, `addToRoot` etc. Check [AddObjectOptions](https://threepipe.org/docs/interfaces/AddObjectOptions.html) and [ImportAddOptions](https://threepipe.org/docs/interfaces/ImportAddOptions.html) for more details.
  291. ### Materials
  292. The materials downloaded as PMAT/BMAT/JSON etc from threepipe,
  293. webgi or the editor can be loaded
  294. and registered with the [MaterialManager](https://threepipe.org/docs/classes/MaterialManager)
  295. using the `viewer.load` method.
  296. Custom material types can also be registered by plugins(like dmat for diamonds), which can also be loaded automatically using the `viewer.load` method.
  297. ```typescript
  298. const pMaterial = await viewer.load<PhysicalMaterial>('https://example.com/file.pmat')
  299. const bMaterial = await viewer.load<UnlitMaterial>('https://example.com/file.bmat')
  300. // ... load any material file as a material
  301. ```
  302. Casting to [PhysicalMaterial](https://threepipe.org/docs/classes/PhysicalMaterial) or [UnlitMaterial](https://threepipe.org/docs/classes/UnlitMaterial) is optional but recommended to get the proper type and autocomplete for the material.
  303. To assign the material on any object, set it to `object.material`
  304. ```typescript
  305. // find a loaded mesh in the scene
  306. const object = viewer.scene.getObjectByName('objectName');
  307. // assign the material
  308. object.material = pMaterial;
  309. ```
  310. To copy the properties without changing the material reference, use `material.copy()` or `material.setValues()` methods.
  311. ```typescript
  312. object.material.copy(pMaterial);
  313. // or use material manager to apply to multiple materials.
  314. viewer.assetManager.materialManager.applyMaterial(pMaterial, 'METAL') // apply props to all materials/objects with the name METAL
  315. ```
  316. TODO: add examples for material load and copy
  317. ### Images/Textures
  318. Images can be loaded using the `viewer.load` method.
  319. There is built-in support for loading all image formats supported by the browser (webp, png, jpeg, jpg, svg, ico, avif) and hdr, exr, hdr.png formats for all browsers.
  320. More formats like ktx2, ktx, etc. can be added using plugins.
  321. ```typescript
  322. const texture = await viewer.load<ITexture>('https://example.com/file.png')
  323. // ... load any image file as a texture
  324. ```
  325. Casting to [ITexture](https://threepipe.org/docs/interfaces/ITexture.html) is optional
  326. but recommended to get the proper type and autocomplete for the texture.
  327. It inherits from three.js [Texture](https://threejs.org/docs/#api/en/textures/Texture) and adds some additional properties.
  328. To assign the texture on any material, set it to `material.map`
  329. ```typescript
  330. // find a loaded mesh in the scene
  331. const object = viewer.scene.getObjectByName('objectName');
  332. const material = object.material as PhysicalMaterial;
  333. // assign the texture
  334. material.map = texture;
  335. material.setDirty() // to let the viewer know that the material has changed and needs to re-render the scene. This will also trigger fade effect if FrameFadePlugin is added.
  336. ```
  337. Check out the image load example to see it in action or to check the JS equivalent code: https://threepipe.org/examples/#image-load/
  338. ### Zip files
  339. .zip files are automatically unzipped and the files are sent to re-load recursively when loaded with `viewer.load`.
  340. Any level of zip hierarchy is flattened.
  341. Loading files like .gltf with references to assets inside the zip file,
  342. any relative references are also automatically resolved.
  343. This is supported for file types like gltf, glb, obj,
  344. etc which support references to external files and has `root` set to `true in [IImporter](https://threepipe.org/docs/interfaces/IImporter.html).
  345. ```typescript
  346. const objectGltf = await viewer.load<IObject3D>('https://example.com/model.gltf.zip')
  347. ```
  348. If we know that the zip file contains a single gltf with all the assets, we can cast the result to [IObject3D](https://threepipe.org/docs/interfaces/IObject3D.html) type.
  349. To load multiple assets from zip files like multiple textures or materials, use `viewer.assetManager.addAsset` method which returns a promise of array of loaded assets.
  350. ```typescript
  351. const textures = await viewer.assetManager.addAsset<ITexture[]>('https://example.com/textures.zip')
  352. const materials = await viewer.assetManager.addAsset<IMaterial[]>('https://example.com/materials.zip')
  353. ```
  354. The auto import of zip contents can be disabled to get the files and blobs in the zip
  355. ```typescript
  356. const zip = await viewer.load<any>('https://example.com/file.zip', {autoImportZipContents: false})
  357. ```
  358. TODO - add example for loading zip files.
  359. ### txt, json files
  360. Text and JSON files can be loaded using the `viewer.load` method and return strings and objects respectively.
  361. ```typescript
  362. const text = await viewer.load<string>('https://example.com/file.txt')
  363. const json = await viewer.load<any>('https://example.com/file.json')
  364. ```
  365. ### Data URLs
  366. Data URLs can be loaded using the `viewer.load` method. The correct mime-type is required to be set in the data URL for finding the correct importer.
  367. ```typescript
  368. const dataUrl = 'data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAUA' // ... some data url
  369. const texture = await viewer.load<ITexture>(dataUrl)
  370. ```
  371. ### Local files, File and Blob
  372. Local files can be loaded using the `viewer.load` method by passing a [IAsset](https://threepipe.org/docs/interfaces/IAsset) object with [File](https://developer.mozilla.org/en-US/docs/Web/API/File) or [Blob](https://developer.mozilla.org/en-US/docs/Web/API/Blob) object.
  373. ```typescript
  374. const file: File|Blob = fileObject // create a new file, blob or get from input element
  375. const text = await viewer.load<IObject>({
  376. // a path/name is required to determine the proper importer by extension. `file.name` can also be used if available
  377. path: 'file.glb',
  378. file
  379. })
  380. ```
  381. The same can be done for any file type.
  382. To load a `Map` of files(like when multiple files are dragged and dropped on the webpage) with internal references to other files, use `viewer.assetManager.importer.importFiles` method. Check the source for [DropzonePlugin](#dropzoneplugin) for an example.
  383. ### Background, Environment maps
  384. The background and environment maps can be set using the `viewer.setBackgroundMap` and `viewer.setEnvironmentMap` methods respectively. These accept both loaded textures from `viewer.load` and direct URLs. Files can be of any image format including hdr, exr.
  385. ```typescript
  386. await viewer.setEnvironmentMap('https://example.com/file.hdr')
  387. await viewer.setBackgroundMap('https://example.com/file.png')
  388. ```
  389. The same texture can be set to both by setting `setBackground` or `setEnvironment` to true in the options:
  390. ```typescript
  391. await viewer.setEnvironmentMap('https://example.com/file.hdr', {setBackground: true})
  392. ```
  393. Check the HDR Load example to see it in action: https://threepipe.org/examples/#hdr-load/
  394. ### SVG strings
  395. SVG strings can be converted to data urls using the [svgUrl](https://repalash.com/ts-browser-helpers/functions/svgUrl.html) string template function
  396. ```typescript
  397. const svgDataUrl = svgUrl`<svg viewBox="0 0 100 100" xmlns="http://www.w3.org/2000/svg"> ... </svg>`;
  398. const texture = await viewer.load<ITexture>(dataUrl)
  399. ```
  400. ### Custom file types
  401. Custom file importers/loaders can be registered to the `AssetImporter` using the `addImporter` method.
  402. ```typescript
  403. class CustomLoader extends FileLoader implements ILoader{
  404. constructor(manager?: LoadingManager) {
  405. super(manager);
  406. }
  407. load(url: string, onLoad: (data: any) => void, onProgress?: (event: ProgressEvent) => void, onError?: (event: ErrorEvent) => void): Mesh {
  408. this.setResponseType('json')
  409. return super.load(url, (json: any)=>{
  410. const mat = new PhysicalMaterial(json)
  411. onLoad?.(mat)
  412. }, onProgress, onError)
  413. }
  414. }
  415. viewer.assetManager.importer.addImporter(new Importer(CustomLoader, ['ext'], ['mime/type'], false))
  416. // load the file
  417. const mat = await viewer.load<PhysicalMaterial>('https://example.com/file.ext')
  418. ```
  419. ## Exporting files
  420. Threepipe has support for exporting various asset type with AssetManager,
  421. as well as support to export viewer and plugin configuration, arbitrary objects etc using the [serialization](#serialization) system.
  422. [viewer.export()](https://threepipe.org/docs/classes/ThreeViewer.html#export) is a high-level wrapper for exporting scene objects, materials, textures, render targets, viewer/scene configuration and plugin configurations.
  423. AssetManager internally uses [AssetExporter](https://threepipe.org/docs/classes/AssetExporter.html) to export files.
  424. AssetExporter includes some basic exporters for glb, exr, textures,
  425. and materials and a system to register exporters for different file types with plugins or custom exporters.
  426. ### Exporting 3D models
  427. Export the root scene as glb
  428. ```typescript
  429. const blob = await viewer.exportScene({
  430. viewerConfig: true, // default = true. export all viewer and plugin configuration. if false only the model root object is exported.
  431. })
  432. // download the file
  433. downloadBlob(blob, 'scene.glb')
  434. ```
  435. Export a single object from the scene as glb
  436. ```typescript
  437. const object = viewer.scene.getObjectByName('objectName');
  438. const glb: Blob = await viewer.export(object, {
  439. exportExt: 'glb', // default = glb for models
  440. embedUrlImages: true, // default = false. embed images in glb even when url is available.
  441. })
  442. // download the file
  443. downloadBlob(glb, 'object.glb')
  444. ```
  445. Check the example [glb-export](https://threepipe.org/examples/#glb-export/) to see a demo.
  446. ### Exporting Materials
  447. Export a material
  448. ```typescript
  449. const material = viewer.assetManager.materialManager.findMaterialsByName('materialName')[0];
  450. // or
  451. // const material = viewer.scene.getObjectByName('objectName').material;
  452. const blob = await viewer.export(material)
  453. // download the file
  454. downloadBlob(blob, 'material.' + blob.ext)
  455. ```
  456. Check the example [pmat-material-export](https://threepipe.org/examples/#pmat-material-export/) to see a demo.
  457. ### Exporting Canvas Images
  458. Canvas Screenshot/snapshot can be exported as png, jpeg or webp(if supported by the browser)
  459. ```typescript
  460. const blob = await viewer.getScreenshotBlob({mimeType: 'image/' + type, quality: 0.85})
  461. // or to get data url:
  462. // const dataUrl = await viewer.getScreenshotDataUrl({mimeType: 'image/' + type, quality: 0.85})
  463. // download the file
  464. downloadBlob(blob, 'screenshot.' + blob.ext)
  465. ```
  466. Check the example [image-snapshot-export](https://threepipe.org/examples/#image-snapshot-export/) to see a demo.
  467. ### Exporting Textures
  468. Textures can be exported to JSON using `viewer.export` or `AssetExporter`
  469. ```typescript
  470. const texture = await viewer.load('https://example.com/file.jpeg')
  471. const blob = await viewer.export(texture)
  472. downloadBlob(blob, texture.name + '.' + blob.ext)
  473. ```
  474. Render target textures can be exported with `viewer.renderManager.exportRenderTarget` or `viewer.export`,
  475. read about [Exporting Render Targets](#exporting-render-targets) below.
  476. TODO: add examples for texture export
  477. Textures and Uint8 Data Textures can be exported as a data url or copied to a new canvas
  478. ```typescript
  479. // get a base64 data url
  480. const dataUrl = textureToDataUrl(texture, 4096, false, 'image/png') // texture or data texture, max-size, flipY, mimeType
  481. // or copy to a new canvas
  482. const canvas = textureToCanvas(texture, 4096) // texture or data texture, max-size
  483. ```
  484. Data Textures of type Half float and Float can be exported with `viewer.export`
  485. ```typescript
  486. const dataTex = await viewer.load('https://example.com/file.hdr')
  487. const blob = await viewer.export(dataTexture, {exportExt: 'exr'})
  488. ```
  489. Check the example [hdr-to-exr](https://threepipe.org/examples/#hdr-to-exr/) to see a demo of HDR to EXR conversion.
  490. TODO: add support to export unsigned byte textures as png, jpeg, webp
  491. ### Exporting Images
  492. Exporting Textures as Images with image of types ImageBitmap, HTMLImageElement,
  493. HTMLOrSVGImageElement, CanvasImageSource, HTMLCanvasElement,
  494. OffscreenCanvas can be exported to png data urls with [imageBitmapToBase64](https://repalash.com/ts-browser-helpers/functions/imageBitmapToBase64.html) function.
  495. ```typescript
  496. const texture = await viewer.load('https://example.com/file.jpeg')
  497. const dataUrl = await imageBitmapToBase64(texture.image, 'image/png', 0.85);
  498. ```
  499. TODO: add support for texture export as images in AssetExporter
  500. ### Exporting Render Targets
  501. Unsigned byte render targets can be exported as png, jpeg or webp(if supported by the browser)
  502. ```typescript
  503. const depthPlugin = viewer.addPluginSync(DepthBufferPlugin, UnsignedByteType)
  504. // wait for the first render
  505. const blob = await viewer.export(depthPlugin.target!, {exportExt: 'png'})
  506. if (blob) downloadBlob(blob, target.texture.name + '.' + blob.ext)
  507. ```
  508. Half float and float render targets can be exported as exr
  509. ```typescript
  510. const depthPlugin = viewer.addPluginSync(DepthBufferPlugin, HalfFloatType)
  511. // wait for the first render
  512. const blob = await viewer.export(depthPlugin.target!, {exportExt: 'exr'})
  513. if (blob) downloadBlob(blob, target.texture.name + '.' + blob.ext)
  514. ```
  515. Note: `exportExt` is determined automatically if not specified.
  516. ## Render pipeline
  517. Threepipe includes a [RenderManager](https://threepipe.org/docs/classes/RenderManager.html) for managing the composition pipeline, and provides helpers for rendering and render target management.
  518. The RenderManager includes a [EffectComposer](https://threejs.org/docs/#api/en/postprocessing/EffectComposer) from three.js for rendering passes and a [WebGLRenderer](https://threejs.org/docs/#api/en/renderers/WebGLRenderer) for rendering,
  519. but the pass management and sorting is managed by the RenderManager itself.
  520. The RenderManager inherits from [RenderTargetManager](https://threepipe.org/docs/classes/RenderTargetManager.html)
  521. which provides utilities for creating, tracking and destroying dedicated and temporary render targets.
  522. ### Render Targets
  523. Render targets can be created
  524. using the `viewer.renderManager.createTarget` and `viewer.renderManager.createTargetCustom` methods.
  525. These can then be disposed using the `viewer.renderManager.disposeTarget` method when not needed anymore.
  526. Or to create temp targets for one time use `viewer.renderManager.getTempTarget` and `viewer.renderManager.releaseTempTarget` methods.
  527. can be used.
  528. All created render targets are tracked in the RenderManager,
  529. and are resized and disposed automatically when needed along with the viewer.
  530. ```typescript
  531. const newTarget = viewer.renderManager.createTarget({sizeMultiplier: 1})
  532. // or
  533. const newTarget2 = viewer.renderManager.createTarget({size: {
  534. width: 1024,
  535. height: 1024,
  536. },
  537. type: HalfFloatType
  538. })
  539. // or clone an existing target
  540. const newTarget3 = viewer.renderManager.composerTarget.clone()
  541. // for multi-sample render target
  542. const newTarget4 = viewer.renderManager.createTarget({sizeMultiplier: 1, samples: 4})
  543. // or create a custom target
  544. const newTarget5 = viewer.renderManager.createTargetCustom(
  545. {width: 1024, height: 1024},
  546. {type: HalfFloatType},
  547. WebGLCubeRenderTarget
  548. )
  549. // dispose targets
  550. viewer.renderManager.disposeTarget(newTarget)
  551. viewer.renderManager.disposeTarget(newTarget2)
  552. viewer.renderManager.disposeTarget(newTarget3)
  553. viewer.renderManager.disposeTarget(newTarget4)
  554. viewer.renderManager.disposeTarget(newTarget5)
  555. // get a temporary target
  556. const tempTarget = viewer.renderManager.getTempTarget({sizeMultiplier: 1})
  557. // release the temporary target
  558. viewer.renderManager.releaseTempTarget(tempTarget)
  559. ```
  560. Note: Render targets created with a sizeMultiplier are automatically resized when the canvas is resized.
  561. ### Passes
  562. By default, the render pipeline includes 2 passes -
  563. [RenderPass](https://threejs.org/docs/#api/en/postprocessing/RenderPass) for rendering the scene hierarchy and [ScreenPass](https://threejs.org/docs/#api/en/postprocessing/ShaderPass)
  564. for rendering the final output on the canvas.
  565. More passes can be added and removed from the pipeline
  566. using the [registerPass](https://threepipe.org/docs/classes/RenderManager.html#registerPass) and [unregisterPass](https://threepipe.org/docs/classes/RenderManager.html#unregisterPass) methods.
  567. The pipeline passes need
  568. to follow the interface of [IPipelinePass](https://threepipe.org/docs/interfaces/IPipelinePass.html) and [IPipelinePassPlugin](https://threepipe.org/docs/interfaces/IPipelinePassPlugin.html).
  569. Which adds some important parameters over the three.js Pass,
  570. like pass id and support for defining where the pass should be added in the pipeline and it's dependants.
  571. ```typescript
  572. const pass = new GBufferRenderPass('customPass', viewer.renderManager.createTarget({sizeMultiplier: 1}))
  573. pass.before = ['render'] // Add the pass before the render pass
  574. pass.after = [] // Add the pass after these passes (none in this case)
  575. pass.required = ['render'] // render pass is required to be in the pipeline for this
  576. viewer.renderManager.registerPass(pass)
  577. ```
  578. Note:
  579. See [PipelinePassPlugin](https://threepipe.org/docs/classes/PipelinePassPlugin.html) for an abstract plugin
  580. that provides the boilerplate to create a plugin that registers a custom pass in the pipeline.
  581. Check [NormalBufferPlugin](https://threepipe.org/docs/classes/NormalBufferPlugin.html) for an example of that.
  582. Note: All effects in post-processing or material extension need not be a separate pass in the pipeline.
  583. Most effects can be achieved with either extending the scene object material shaders or the Screen Pass material shader
  584. using [Material extension](#material-extension) system
  585. ## Material Extension
  586. Threepipe includes a Material extension system along with a material manager.
  587. The material manager is used to register materials and material extensions.
  588. The material extensions are used to extend any material in the scene,
  589. or any plugin/pass with additional uniforms, defines, shader snippets and provides hooks.
  590. The material extensions are automatically applied to all materials in the scene that are compatible,
  591. when the extension is registered or when the material is added to the scene.
  592. Threepipe includes several built-in materials like
  593. [PhysicalMaterial](https://threepipe.org/docs/classes/PhysicalMaterial.html),
  594. [UnlitMaterial](https://threepipe.org/docs/classes/UnlitMaterial.html),
  595. [ExtendedShaderMaterial](https://threepipe.org/docs/classes/ExtendedShaderMaterial.html), [LegacyPhongMaterial](https://threepipe.org/docs/classes/LegacyPhongMaterial.html),
  596. that include support for extending the material.
  597. Any three.js material can be made extendable,
  598. check the `ShaderPass2` class for a simple example that adds support for material extension to three.js ShaderPass.
  599. The material extensions must follow the [MaterialExtension](https://threepipe.org/docs/interfaces/MaterialExtension.html) interface.
  600. Many plugins create their own material extensions either for the scene materials or shader passes(like the screen pass).
  601. Some plugins like `DepthBufferPlugin` also provides helper material extensions for other custom plugins
  602. to fetch value in the depth buffer.
  603. A sample material extension
  604. ```typescript
  605. const extension: MaterialExtension = {
  606. shaderExtender: (shader)=> {
  607. // change the shader properties like shader.fragmentShader, etc
  608. },
  609. parsFragmentSnippet: ` // add some code before the main function in the fragment shader
  610. uniform sampler2D tTexture;
  611. uniform float opacity;
  612. `,
  613. extraUniforms: {
  614. tTexture: ()=>({value: getTexture()}),
  615. opacity: {value: 1}
  616. // add additional uniforms, these can be IUniform or functions that return IUniform
  617. },
  618. extraDefines: {
  619. ['DEPTH_PACKING']: BasicDepthPacking,
  620. ['SOME_DEFINE']: ()=>"1",
  621. // add additional defines, these can be values or functions that return values
  622. },
  623. priority: 100, // priority when using multiple extensions on the same material
  624. isCompatible: (material) => material.isMeshBasicMaterial, // check if the material is compatible with this extension,
  625. computeCacheKey: (material) => material.uuid, // a custom cache key for the material extension. Shader is recompiled when this is changed
  626. onObjectRender: (object: Object3D, material: IMaterial) => {
  627. // called when some object is rendererd which has a material with this extension.
  628. },
  629. // uiConfig
  630. // check more properties and hooks in the MaterialExtension interface
  631. }
  632. // The extension can be registered to all the materials using the MaterialManager
  633. viewer.assetManager.materialManager.registerMaterialExtension(extension)
  634. // or register it on a single material (like the Screen Pass)
  635. viewer.renderManager.screenPass.material.registerMaterialExtensions([extension])
  636. ```
  637. ## UI Configuration
  638. Most of the classes and plugins in Threepipe include [uiconfig.js](https://repalash.com/uiconfig.js/) support
  639. and can be used to create configuration UIs, 3d configurators and even full-editors.
  640. The UIs are automatically generated based on the configuration object under `.uiConfig` property on all objects.
  641. These are of type [UiObjectConfig](https://repalash.com/uiconfig.js/interfaces/UiObjectConfig.html).
  642. In some classes, the ui configs are also generated using typescript decorators.
  643. The `uiConfig` is also added to all three.js objects and materials when they are added to the scene.
  644. The UIs can be generated at runtime using any of the UI plugins like [TweakpaneUIPlugin](#threepipeplugin-tweakpane), [BlueprintJsUiPlugin](#threepipeplugin-blueprintjs)
  645. An example showing how to create a UI for a material
  646. ```typescript
  647. const ui = viewer.addPluginSync(TweakpaneUiPlugin)
  648. const object = viewer.scene.getObjectByName('objectName');
  649. const material = object.material as PhysicalMaterial;
  650. ui.appendChild(material.uiConfig)
  651. ```
  652. See it in action: https://threepipe.org/examples/#material-uiconfig/
  653. Check more examples showing [Viewer UI](https://threepipe.org/examples/#viewer-uiconfig/),
  654. [Scene UI](https://threepipe.org/examples/#scene-uiconfig/),
  655. [Object UI](https://threepipe.org/examples/#object-uiconfig/), [Camera UI](https://threepipe.org/examples/#camera-uiconfig/)
  656. [TweakpaneEditorPlugin](#threepipeplugin-tweakpane-editor) further uses the Tweakpane configuration panel along with various plugins to create an 3d editor.
  657. Custom UI configuration can be created to generate custom UI for the editor or tweaking.
  658. This can be done by using typescript decorators or defining the UI in javascript as a [UiObjectConfig](https://repalash.com/uiconfig.js/interfaces/UiObjectConfig.html) object.
  659. Here is a sample of extending the orbit controls class with decorators to automatically generate UI.
  660. ```typescript
  661. @uiPanelContainer('Orbit Controls')
  662. export class OrbitControlsWithUi extends OrbitControls implements IUiConfigContainer {
  663. // for autocomplete
  664. uiConfig?: UiObjectConfig<void, 'panel'>
  665. @uiToggle() enabled = true
  666. @uiToggle() dollyZoom = false
  667. @uiToggle() enableDamping = true
  668. @uiInput() dampingFactor = 0.08
  669. @uiToggle() autoRotate = false
  670. @uiInput() autoRotateSpeed = 2.0
  671. @uiToggle() enableZoom = true
  672. @uiInput() zoomSpeed = 0.15
  673. @uiInput() maxZoomSpeed = 0.20
  674. @uiToggle() enableRotate = true
  675. @uiInput() rotateSpeed = 2.0
  676. @uiToggle() enablePan = true
  677. @uiInput() panSpeed = 1.0
  678. @uiInput() autoPushTarget = false
  679. @uiInput() autoPullTarget = false
  680. @uiInput() minDistance = 0.35
  681. @uiInput() maxDistance = 1000
  682. @uiInput() minZoom = 0.01
  683. @uiInput() maxZoom = 1000
  684. @uiInput() minPolarAngle = 0
  685. @uiInput() maxPolarAngle = Math.PI
  686. @uiInput() minAzimuthAngle = -10000 // should be -Infinity but this breaks the UI
  687. @uiInput() maxAzimuthAngle = 10000
  688. }
  689. ```
  690. Check out the full source code:
  691. [./src/three/controls/OrbitControls3.ts](./src/three/controls/OrbitControls3.ts) for proper implementation
  692. See it in action: https://threepipe.org/examples/#camera-uiconfig/ Open the Camera UI and click on the Orbit Controls panel.
  693. There are many available decorators like `uiToggle`, `uiSlider`, `uiInput`, `uiNumber`, `uiColor`, `uiImage`.
  694. Check the complete list in the [uiconfig.js documentation](https://repalash.com/uiconfig.js/).
  695. The UI configuration can also be created using json objects in both typescript and javascript
  696. ```javascript
  697. const viewer = new ThreeViewer({...})
  698. const ui = viewer.addPluginSync(TweakpaneUiPlugin)
  699. const state = {
  700. position: new Vector3(),
  701. scale: 1,
  702. }
  703. ui.appendChild({
  704. type: 'folder',
  705. label: 'Custom UI',
  706. children: [
  707. {
  708. type: 'vec3',
  709. label: 'Position',
  710. property: [state, 'position']
  711. },
  712. {
  713. type: 'slider',
  714. label: ()=>'Scale', // everything can be a function as well.
  715. property: [state, 'scale'],
  716. bounds: [1, 2],
  717. stepSize: 0.1,
  718. }
  719. ]
  720. })
  721. ```
  722. TODO: create example/codepen for this
  723. ## Serialization
  724. Easy serialization of all threepipe and most three.js objects are supported out of the box using the Asset Manager.
  725. Fine control over serialization is also supported
  726. using the [ThreeSerialization](https://threepipe.org/docs/classes/ThreeSerialization.html) class
  727. Call `ThreeSerialization.serialize` on any object to serialize it.
  728. and `ThreeSerialization.deserialize` to deserialize the serialized object.
  729. This is done by performing a nested serialization of all the properties of the object.
  730. It's possible to implement custom serializers for custom types and classes and is done for three.js primitives,
  731. objects and plugins in threepipe
  732. To make a custom data class that is serializable,
  733. mark it using `@serializable` decorator and any properties using `@serialize` decorator.
  734. ```typescript
  735. @serializable('DataClass')
  736. class DataClass{
  737. @serialize() prop1 = 1
  738. @serialize() prop2 = 'string'
  739. @serialize() prop3 = new Vector3()
  740. @serialize() prop4 = new PhysicalMaterial()
  741. @serialize() prop4 = {
  742. prop1: 1,
  743. prop2: 'string',
  744. prop3: new Vector3(),
  745. prop4: new PhysicalMaterial(),
  746. }
  747. }
  748. const data = new DataClass()
  749. const serialized = ThreeSerialization.serialize(data)
  750. const deserialized = ThreeSerialization.deserialize(serialized)
  751. ```
  752. The classes without a `@serializable` decorator are serialized as plain objects.
  753. These can still include `@serialize` decorator to mark the properties are serializable
  754. but these classes cannot be deserialized into a new instance of the class.
  755. The ThreeViewer and plugins are an example of these.
  756. When deserialized they need an object to deserialize into.
  757. This ensures there is always just one instance.
  758. With this, the serialization system works like `toJSON` and `fromJSON` methods in three.js.
  759. Check the [plugin system](#plugin-system) below for more details on how to mark properties as serializable for plugins.
  760. ```typescript
  761. class CustomClass{
  762. @serialize() prop1 = 1
  763. @serialize() prop2 = 'string'
  764. @serialize() prop3 = new Vector3()
  765. @serialize() prop4 = new PhysicalMaterial()
  766. }
  767. const obj = new DataClass()
  768. const serialized = ThreeSerialization.serialize(data)
  769. // now to deserialize we need to pass in the object to deserialize into
  770. ThreeSerialization.deserialize(serialized, obj)
  771. ```
  772. ## Plugin System
  773. Threepipe includes a plugin system for adding additional features to the viewer in a modular way.
  774. The plugins can be added synchronously or asynchronously using `viewer.addPluginSync` and `viewer.addPlugin` methods respectively.
  775. It is recommended to create custom plugins for reusable features,
  776. as they provide built-in features for ui configuration,
  777. serialization, integration with editors etc and are easy to manage and tree-shake in the code.
  778. Check out the list of plugins in the [Plugin List](#threepipe-plugins) section below.
  779. To create new plugins,
  780. simply implement the `IViewerPlugin` interface or extend the [AViewerPluginSync](https://threepipe.org/docs/classes/AViewerPluginSync.html) or [AViewerPluginAsync](https://threepipe.org/docs/classes/AViewerPluginAsync.html) classes.
  781. The only difference is that in async the `onAdded` and `onRemove` functions are async
  782. Here is a sample plugin
  783. ```typescript
  784. @uiFolder("Sample Plugin") // This creates a folder in the Ui. (Supported by TweakpaneUiPlugin)
  785. export class SamplePlugin extends AViewerPluginSync<"sample-1" | "sample-2"> {
  786. // These are the list of events that this plugin can dispatch.
  787. static readonly PluginType = "SamplePlugin"; // This is required for serialization and handling plugins. Also used in viewer.getPluginByType()
  788. @uiToggle() // This creates a checkbox in the Ui. (Supported by TweakpaneUiPlugin)
  789. @serialize() // Adds this property to the list of serializable. This is also used when serializing to glb in AssetExporter.
  790. enabled = true;
  791. // A plugin can have custom properties.
  792. @uiSlider("Some Number", [0, 100], 1) // Adds a slider to the Ui, with custom bounds and step size (Supported by TweakpaneUiPlugin)
  793. @serialize("someNumber")
  794. @onChange(SamplePlugin.prototype._updateParams) // this function will be called whenevr this value changes.
  795. val1 = 0;
  796. // A plugin can have custom properties.
  797. @uiInput("Some Text") // Adds a slider to the Ui, with custom bounds and step size (Supported by TweakpaneUiPlugin)
  798. @onChange(SamplePlugin.prototype._updateParams) // this function will be called whenevr this value changes.
  799. @serialize()
  800. val2 = "Hello";
  801. @uiButton("Print Counters") // Adds a button to the Ui. (Supported by TweakpaneUiPlugin)
  802. public printValues = () => {
  803. console.log(this.val1, this.val2);
  804. this.dispatchEvent({ type: "sample-1", detail: { sample: this.val1 } }); // This will dispatch an event.
  805. }
  806. constructor() {
  807. super();
  808. this._updateParams = this._updateParams.bind(this);
  809. }
  810. private _updateParams() {
  811. console.log("Parameters updated.");
  812. this.dispatchEvent({ type: "sample-2" }); // This will dispatch an event.
  813. }
  814. onAdded(v: ThreeViewer): void {
  815. super.onAdded(v);
  816. // Do some initialization here.
  817. this.val1 = 0;
  818. this.val2 = "Hello";
  819. v.addEventListener("preRender", this._preRender);
  820. v.addEventListener("postRender", this._postRender);
  821. v.addEventListener("preFrame", this._preFrame);
  822. v.addEventListener("postFrame", this._postFrame);
  823. this._viewer!.scene.addEventListener("addSceneObject", this._objectAdded); // this._viewer can also be used while this plugin is attached.
  824. }
  825. onRemove(v: ThreeViewer): void {
  826. // remove dispose objects
  827. v.removeEventListener("preRender", this._preRender);
  828. v.removeEventListener("postRender", this._postRender);
  829. v.removeEventListener("preFrame", this._preFrame);
  830. v.removeEventListener("postFrame", this._postFrame);
  831. this._viewer!.scene.removeEventListener("addSceneObject", this._objectAdded); // this._viewer can also be used while this plugin is attached.
  832. super.onRemove(v);
  833. }
  834. private _objectAdded = (ev: IEvent<any>) => {
  835. console.log("A new object, texture or material is added to the scene.", ev.object);
  836. };
  837. private _preFrame = (ev: IEvent<any>) => {
  838. // This function will be called before each frame. This is called even if the viewer is not dirty, so it's a good place to do viewer.setDirty()
  839. };
  840. private _preRender = (ev: IEvent<any>) => {
  841. // This is called before each frame is rendered, only when the viewer is dirty.
  842. };
  843. // postFrame and postRender work the same way as preFrame and preRender.
  844. }
  845. ```
  846. Notes:
  847. * All plugins that are present in the dependencies array when the plugin is added to the viewer, are created and attached to the viewer in `super.onAdded`
  848. * Custom events can be dispatched with `this.dispatchEvent`, and subscribed to with `plugin.addEventListener`. The event type must be described in the class signature for typescript autocomplete to work.
  849. * Event listeners and other hooks can be added and removed in `onAdded` and `onRemove` functions for the viewer and other plugins.
  850. * To the viewer render the next frame, `viewer.setDirty()` can be called, or set `this.dirty = true` in preFrame and reset in postFrame to stop the rendering. (Note that rendering may continue if some other plugin sets the viewer dirty like `ProgressivePlugin` or any of the animation plugins). Check `isConverged` in `ProgressivePlugin` to check if its the final frame.
  851. * All Plugins which inherit from AViewerPlugin support serialisation. Create property `serializeWithViewer = false` to disable serialisation with the viewer in config and glb or `toJSON: any = undefined` to disable serialisation entirely
  852. * `plugin.toJSON()` and `plugin.fromJSON()` or `ThreeSerialization` can be used to serialize and deserialize plugins. `viewer.exportPluginConfig` and `viewer.importPluginConfig` also exist for this.
  853. * @serialize('label') decorator can be used to mark any public/private variable as serializable. label (optional) corresponds to the key in JSON.
  854. * @serialize supports instances of ITexture, IMaterial, all primitive types, simple JS objects, three.js math classes(Vector2, Vector3, Matrix3...), and some more.
  855. * uiDecorators can be used to mark properties and functions that will be shown in the Ui. The Ui shows up automatically when TweakpaneUiPlugin/BlueprintJsUiPlugin is added to the viewer. Plugins have special features in the UI for download preset and saving state.
  856. Check various plugins in the source code for more examples.
  857. # Viewer API
  858. [ThreeViewer](https://threepipe.org/docs/classes/ThreeViewer.html) - is the main entry point to 3d rendering on the canvas.
  859. - `.renderManager`: [ViewerRenderManager](https://threepipe.org/docs/classes/ViewerRenderManager.html) & [RenderManager](https://threepipe.org/docs/classes/RenderManager.html) & [RenderTargetManager](https://threepipe.org/docs/classes/RenderTargetManager.html) - Render manager for managing the rendering and composition pipeline, and provides helpers for rendering and render target management
  860. - `.renderer`: [IWebGLRenderer](https://threepipe.org/docs/interfaces/IWebGLRenderer.html) - for rendering. Instance of three.js [WebGLRenderer](https://threejs.org/docs/#api/en/renderers/WebGLRenderer)
  861. - `.composer`: [EffectComposer2](https://threepipe.org/docs/classes/EffectComposer2.html) - for rendering passes. Instance of three.js [EffectComposer](https://threejs.org/docs/#api/en/postprocessing/EffectComposer)
  862. - `.context`: [WebGLRenderingContext](https://developer.mozilla.org/en-US/docs/Web/API/WebGLRenderingContext) - WebGL rendering context
  863. - `.renderPass`: [ExtendedRenderPass](https://threepipe.org/docs/classes/ExtendedRenderPass.html) - Render pass for rendering the scene. Instance of three.js [RenderPass](https://threejs.org/docs/#api/en/postprocessing/RenderPass) with extra features
  864. - `.screenPass`: [ScreenPass](https://threepipe.org/docs/classes/ScreenPass.html) - Screen pass for rendering the final output. Instance of three.js [ShaderPass](https://threejs.org/docs/#api/en/postprocessing/ShaderPass) with extra features.
  865. - `.scene`: [RootScene](https://threepipe.org/docs/classes/RootScene.html) - Main scene used for rendering. Instance of three.js [Scene](https://threejs.org/docs/#api/en/scenes/Scene)
  866. - `.mainCamera`: [PerspectiveCamera2](https://threepipe.org/docs/classes/PerspectiveCamera2.html) - Main camera currently being used for rendering. Instance of three.js [PerspectiveCamera](https://threejs.org/docs/#api/en/cameras/PerspectiveCamera)
  867. - `.assetManager`: [AssetManager](https://threepipe.org/docs/classes/AssetManager.html) - Asset manager for loading, managing and exporting assets
  868. - `.importer`: [AssetImporter](https://threepipe.org/docs/classes/AssetImporter.html) - for importing assets
  869. - `.exporter`: [AssetExporter](https://threepipe.org/docs/classes/AssetExporter.html) - for exporting assets
  870. - `.materialManager`: [MaterialManager](https://threepipe.org/docs/classes/MaterialManager.html) - for managing materials and material extensions
  871. - `.plugins`: `Record`<`string`, [IViewerPlugin](https://threepipe.org/docs/interfaces/IViewerPlugin.html)> - Plugins added to the viewer
  872. - `.uiConfig`: [UiObjectConfig](https://repalash.com/uiconfig.js/interfaces/UiObjectConfig.html) - UI confguration for the viewer. Used to automatically generate UIs for the viewer and plugins.
  873. ## ThreeViewer
  874. Source Code: [src/viewer/ThreeViewer.ts](./src/viewer/ThreeViewer.ts)
  875. API Reference: [ThreeViewer](https://threepipe.org/docs/classes/ThreeViewer.html)
  876. `ThreeViewer` is the main entry point to the viewer. It provides all the API for managing the scene, camera, rendering, plugins, etc.
  877. It is initialized with either a canvas element or a `HTMLElement` for the container.
  878. The canvas element is used for rendering, and the options are used to configure the viewer.
  879. If the canvas element is not provided, a new canvas element is created and appended to the container.
  880. More options can be passed in the constructor to configure various built-in plugins and rendering features in the viewer.
  881. ### Constructor
  882. ```typescript
  883. import {ThreeViewer, CameraViewPlugin} from 'threepipe'
  884. // Create a viewer. All options except canvas/container are optional
  885. const viewer = new ThreeViewer({
  886. canvas: document.getElementById('mcanvas') as HTMLCanvasElement,
  887. // or a container like:
  888. // container: document.getElementById('mcontainer'),
  889. // container: document.body,
  890. // Set the render scale to render at device resolution
  891. renderScale: window.devicePixelRatio,
  892. // modify the screen shader: See ScreenPass and ScreenPass.glsl for more details
  893. screenShader: `diffuseColor = diffuseColor * 2.0;`,
  894. // Add TonemapPlugin
  895. tonemap: true,
  896. // Use MSAA(anti-aliasing)
  897. msaa: false,
  898. // Use Uint8 RGBM HDR Render Pipeline. Provides better performance with post-processing. RenderManager Uses Half-float if set to false.
  899. rgbm: true,
  900. // Use rendered gbuffer as depth-prepass / z-prepass.
  901. zPrepass: false,
  902. // Options for AssetManager
  903. assetManager: {
  904. // Use a custom CacheStorage
  905. storage: caches.open('threepipe-assetmanager'),
  906. },
  907. // Use DropzonePlugin to add support for file drag and drop
  908. // Enable and set properties
  909. dropzone: {
  910. // Set allowed extensions
  911. allowedExtensions: ['png', 'glb', 'gltf'],
  912. // Automatically add downloaded assets
  913. autoAdd: true
  914. // autoImport: true,
  915. // domElement: document.body,
  916. // addOptions: { ... }
  917. // importOptions: { ... }
  918. },
  919. // By default its false
  920. // dropzone: false,
  921. // To Enable without options
  922. // dropzone: true
  923. // Add some plugins after viewer creation.
  924. plugins: [CameraViewPlugin, new CustomPlugin()],
  925. // Shorthand to load files immediately after viewer initialization
  926. load: {
  927. src: 'https://example.com/file.glb',
  928. environment: 'https://example.com/file.hdr',
  929. background: 'https://example.com/file.png',
  930. },
  931. onLoad: (viewer) => {
  932. // Called when all the files are loaded
  933. },
  934. })
  935. ```
  936. Check the interface [ThreeViewerOptions](https://threepipe.org/docs/interfaces/ThreeViewerOptions.html) for all the options.
  937. To dispose off the viewer and all its resources call [`viewer.dispose()`](https://threepipe.org/docs/classes/ThreeViewer.html#dispose) method.
  938. To dispose only the scene objects and not the complete viewer, use `viewer.scene.disposeSceneModels()`
  939. ### Plugin Functions
  940. ```typescript
  941. import {ThreeViewer, TonemapPlugin, DepthBufferPlugin, NormalBufferPlugin} from 'threepipe'
  942. const viewer = new ThreeViewer({...})
  943. // Add a plugin
  944. const plugin = viewer.addPluginSync(new TonemapPlugin())
  945. // plugins can be added with just the class also
  946. const plugin2 = viewer.addPluginSync(TonemapPlugin)
  947. // Add multiple plugins at once
  948. viewer.addPluginsSync([
  949. TonemapPlugin,
  950. new NormalBufferPlugin(),
  951. DepthBufferPlugin,
  952. // ...
  953. ])
  954. // Get a plugin
  955. const plugin3 = viewer.getPlugin(TonemapPlugin)
  956. // Get or add a plugin, when not sure if the plugin is already added
  957. const plugin4 = viewer.getOrAddPluginSync(TonemapPlugin)
  958. // Remove a plugin
  959. viewer.removePluginSync(TonemapPlugin)
  960. ```
  961. Note: all sync functions above have async counterparts like `addPlugin`, `getOrAddPlugin`,
  962. `removePlugin` that are used for async plugins.
  963. There are no async plugins built-in to threepipe yet.
  964. ### Import/Export Functions
  965. ```typescript
  966. import {ThreeViewer} from 'threepipe'
  967. const viewer = new ThreeViewer({...})
  968. // Load a 3d model
  969. const object = await viewer.load<IObject3D>('https://example.com/file.glb')
  970. // Load a material
  971. const material = await viewer.load<PhysicalMaterial>('https://example.com/file.pmat')
  972. // Load an image
  973. const texture = await viewer.load<ITexture>('https://example.com/file.png')
  974. // Import a model without adding to the scene
  975. const imported = await viewer.import('https://example.com/file.glb')
  976. // Export the complete scene with viewer configuraion
  977. const exportedScene = await viewer.exportScene({})
  978. // Export an object
  979. const exported = await viewer.export(object)
  980. // Export a material
  981. const exportedMaterial = await viewer.export(material)
  982. // Export a texture
  983. const exportedTexture = await viewer.export(texture)
  984. // Export viewer and plugins configurations
  985. const exportedConfig = await viewer.export(viewer)
  986. // Export plugin configuration
  987. const exportedPlugin = await viewer.exportPlugin(viewer.getPlugin(PluginClass))
  988. // Set Background Image
  989. await viewer.setBackgroundMap('https://example.com/file.png')
  990. // Set Environment Map
  991. await viewer.setEnvironmentMap('https://example.com/file.hdr')
  992. // Add an imported object or a created three.js object to the scene
  993. viewer.addSceneObject(imported)
  994. ```
  995. [`viewer.load`](https://threepipe.org/docs/classes/ThreeViewer.html#load) - Loads a single asset by path or [IAsset](https://threepipe.org/docs/interfaces/IAsset.html) object, and adds to the scene if its 3d object or loads it if it's a configuration It is the same as [AssetManager.addAssetSingle](https://threepipe.org/docs/classes/AssetManager.html#addAssetSingle). Use [AssetManager.addAsset](https://threepipe.org/docs/classes/AssetManager.html#addAsset) to load multiple assets from the same path like in case of zip bundles.
  996. [`viewer.import`](https://threepipe.org/docs/classes/ThreeViewer.html#import) - Load a single asset but does not add to the scene or load the configuration. It is the same as [AssetManager.importer.importSingle](https://threepipe.org/docs/classes/AssetImporter.html#importSingle). Use [AssetManager.importer.import](https://threepipe.org/docs/classes/AssetImporter.html#import) to import multiple assets from the same path like in case of zip bundles.
  997. [`viewer.export`](https://threepipe.org/docs/classes/ThreeViewer.html#export) - Exports an object, material, texture, render target or plugin configuration and returns a Blob. It is similar to [AssetManager.exporter.exportObject](https://threepipe.org/docs/classes/AssetExporter.html#exportObject) but adds support for exporting plugin and self(viewer) configs.
  998. [`viewer.exportScene`](https://threepipe.org/docs/classes/ThreeViewer.html#exportScene) - Exports the scene model root and all configurations into a bundled `glb` file and returns a blob.
  999. [`viewer.exportPlugin`](https://threepipe.org/docs/classes/ThreeViewer.html#exportPlugin) - Exports a plugin configuration and returns a blob.
  1000. [`viewer.setBackgroundMap`](https://threepipe.org/docs/classes/ThreeViewer.html#setBackgroundMap) - Sets the background map to the given texture or url. Also sets it as environment map if `setEnvironment` is `true` in the options.
  1001. [`viewer.setEnvironmentMap`](https://threepipe.org/docs/classes/ThreeViewer.html#setEnvironmentMap) - Sets the environment map to the given texture or url. Also sets it as background if `setBackground` is `true` in the options.
  1002. [`viewer.addSceneObject`](https://threepipe.org/docs/classes/ThreeViewer.html#addSceneObject) - Adds an imported object or a created three.js object to the scene model root. If an imported scene model root is passed, it will be loaded with viewer configuration, unless `importConfig` is `false` in the options.
  1003. ### Frame/Rendering Events
  1004. ```typescript
  1005. import {ThreeViewer} from 'threepipe'
  1006. const viewer = new ThreeViewer({...})
  1007. // Add a callback to be called before every frame, irrespective of whether enything is being rendered that frame
  1008. viewer.addEventListener('preFrame', (ev)=>{
  1009. console.log(ev);
  1010. // change something
  1011. viewer.setDirty() // let the viewer know to re-render the scene from this frame
  1012. })
  1013. // Add a callback to be called after every frame, irrespective of whether enything was rendered that frame
  1014. viewer.addEventListener('postFrame', (ev)=>{
  1015. console.log(ev);
  1016. // change something
  1017. viewer.setDirty() // let the viewer know to re-render the scene from next frame
  1018. })
  1019. // Add a callback to be called before every render, only if something is being rendered that frame
  1020. viewer.addEventListener('preRender', (ev)=>{
  1021. // canvas is about to be rendered, or re-rendered for progressive rendering
  1022. console.log(ev, viewer.renderManager.frameCount);
  1023. })
  1024. // Add a callback to be called after every render, only if something was rendered that frame
  1025. viewer.addEventListener('postRender', (ev)=>{
  1026. // canvas is rendered, or re-rendered for progressive rendering
  1027. console.log(ev);
  1028. })
  1029. // Listen to viewer.setDirty() calls
  1030. viewer.addEventListener('update', (ev)=>{
  1031. // viewer.setDirty() was called by some plugin or code
  1032. console.log(ev);
  1033. })
  1034. // to remove an event listener, first keep a reference to the callback
  1035. const callback = (ev)=>{ return }
  1036. viewer.addEventListener('preFrame', callback)
  1037. // then remove it
  1038. viewer.removeEventListener('preFrame', callback)
  1039. // Add a callback to be called only once for an event
  1040. viewer.doOnce('postFrame', () => viewer.canvas.toDataURL('image/png'))
  1041. // Enable/disable rendering in the viewer
  1042. viewer.renderEnabled = false
  1043. // do something with the canvas or load assets
  1044. await viewer.load('https://example.com/file.glb')
  1045. await viewer.load('https://example.com/file1.glb')
  1046. await viewer.load('https://example.com/file2.glb')
  1047. viewer.renderEnabled = true // all the assets will be rendered together in the next frame
  1048. ```
  1049. Check the [IViewerEvent](https://threepipe.org/docs/interfaces/IViewerEvent.html) interface for all the event types.
  1050. [`viewer.addEventListener`](https://threepipe.org/docs/classes/ThreeViewer.html#addEventListener) - Adds a callback to be called on the given event. The callback is called with an [IViewerEvent](https://threepipe.org/docs/interfaces/IViewerEvent.html) object.
  1051. [`viewer.removeEventListener`](https://threepipe.org/docs/classes/ThreeViewer.html#removeEventListener) - Removes a callback from the given event.
  1052. [`viewer.doOnce`](https://threepipe.org/docs/classes/ThreeViewer.html#doOnce) - Adds a callback to be called only once for the given event. The listener will be added and automatically removed after the first call.
  1053. ### Utility Functions
  1054. ```typescript
  1055. import {ThreeViewer} from 'threepipe'
  1056. const viewer = new ThreeViewer({...})
  1057. // Set size
  1058. viewer.setSize({width: 800, height: 600})
  1059. // Traverse scene objects
  1060. viewer.traverseSceneObjects((object) => {
  1061. console.log(object)
  1062. // do something with object
  1063. })
  1064. // If the size is set by css or manually by javascript use `resize` to update the viewer
  1065. viewer.resize()
  1066. // Trigger re-render with `setDirty` when something changes and viewer is not notified internally
  1067. viewer.setDirty()
  1068. // Get snapshot of the canvas as a blob
  1069. const blob = await viewer.getScreenshotBlob({mimeTye: 'image/png', quality: 90})
  1070. // Get snapshot of the canvas as a data url
  1071. const dataUrl = await viewer.getScreenshotDataUrl({mimeTye: 'image/jpeg', quality: 85})
  1072. // Dispose viewer and all resources
  1073. viewer.canvas.remove() // canvas needs to be removed separately from the DOM
  1074. viewer.dispose()
  1075. ```
  1076. [`viewer.setSize`](https://threepipe.org/docs/classes/ThreeViewer.html#setSize) - Sets the size of the canvas and updates the renderer and the camera. If no width/height is passed, canvas is set to 100% of the container.
  1077. [`viewer.traverseSceneObjects`](https://threepipe.org/docs/classes/ThreeViewer.html#traverseSceneObjects) - Loop through all the objects in the scene model root hierarchy and calls the callback function with each object.
  1078. [`viewer.resize`](https://threepipe.org/docs/classes/ThreeViewer.html#resize) - Mark that the canvas is resized. If the size is changed, the renderer and all render targets are resized.
  1079. [`viewer.setDirty`](https://threepipe.org/docs/classes/ThreeViewer.html#setDirty) - Triggers re-render on next `requestAnimationFrame` call.
  1080. [`viewer.getScreenshotBlob`](https://threepipe.org/docs/classes/ThreeViewer.html#getScreenshotBlob) - Returns a blob of the canvas screenshot. The blob can be used to download the screenshot or upload to a server.
  1081. [`viewer.getScreenshotDataUrl`](https://threepipe.org/docs/classes/ThreeViewer.html#getScreenshotDataUrl) - Returns a data url of the canvas screenshot. The data url can be used to display the screenshot in an image element.
  1082. [`viewer.dispose`](https://threepipe.org/docs/classes/ThreeViewer.html#dispose) - Disposes the viewer and all its resources. Use this to dispose the viewer when it is no longer needed. Note: the canvas element is not removed from the DOM and needs to be removed separately.
  1083. ## RenderManager
  1084. Source Code: [src/viewer/ViewerRenderManager.ts](./src/viewer/ViewerRenderManager.ts), [src/rendering/RenderManager.ts](./src/rendering/RenderManager.ts), [src/rendering/RenderTargetManager.ts](./src/rendering/RenderTargetManager.ts)
  1085. API Reference: [ViewerRenderManager](https://threepipe.org/docs/classes/ViewerRenderManager.html), [RenderManager](https://threepipe.org/docs/classes/RenderManager.html), [RenderTargetManager](https://threepipe.org/docs/classes/RenderTargetManager.html)
  1086. It manages the rendering, composition/postprocessing of the scene and provides helpers for rendering and render target management.
  1087. ```typescript
  1088. const viewer = new ThreeViewer({...})
  1089. const renderManager = viewer.renderManager
  1090. // Get the effect composer
  1091. const composer = renderManager.composer
  1092. // Get the three.js webgl renderer
  1093. const renderer = renderManager.renderer
  1094. // Get the main Render Pass in the pipeline
  1095. const renderPass = renderManager.renderPass
  1096. // Get the main Screen Pass in the pipeline
  1097. const screenPass = renderManager.screenPass
  1098. // Set the render scale
  1099. renderManager.renderScale = Math.min(window.devicePixelRatio, 2)
  1100. // Register a custom composer pass
  1101. const customPass: IPipelinePass = new CustomPass()
  1102. renderManager.registerPass(customPass)
  1103. // Unregister a custom composer pass
  1104. renderManager.unregisterPass(customPass)
  1105. // The pipeline is automatically created and sorted based on dependencies in pipeline pass.
  1106. // To check the built pipeline
  1107. console.log(renderManager.pipeline)
  1108. // Set a custom render pipeline
  1109. renderManager.autoBuildPipeline = false
  1110. renderManager.pipeline = ['depth', 'render', 'screen']
  1111. // Check the total frames rendererd
  1112. console.log(renderManager.totalFrameCount)
  1113. // Get the current frame count in progressive rendering
  1114. console.log(renderManager.frameCount)
  1115. // Force reset shadows when some object is moved
  1116. renderManager.resetShadows()
  1117. // Render Target Management
  1118. // Get the main composer target
  1119. const composerTarget = renderManager.composerTarget
  1120. // clone the target to get a copy of the target with all the default options
  1121. const clonedTarget = composeTarget.clone()
  1122. // Create a render target, same size as the canvas. The target are automatically resized when the canvas is resized
  1123. const renderTarget = renderManager.createTarget({
  1124. sizeMultiplier: 1, // size multiplier from the canvas. 0.5 will be half width and height of the canvas
  1125. type: UnsignedByteType,
  1126. // ... // See CreateRenderTargetOptions for all options
  1127. })
  1128. // Create a render target of custom size
  1129. const renderTarget = renderManager.createTarget({
  1130. size: {
  1131. width: 1024,
  1132. height: 1024,
  1133. },
  1134. type: HalfFloatType,
  1135. // ...
  1136. })
  1137. // Dispose the render target
  1138. renderManager.disposeTarget(renderTarget)
  1139. // Create and release temporary targets for in-pass rendering.
  1140. const tempTarget = renderManager.getTempTarget({
  1141. sizeMultiplier: 0.5,
  1142. type: HalfFloatType,
  1143. // ...
  1144. })
  1145. // do something
  1146. renderManager.releaseTempTarget(tempTarget)
  1147. // Set how many temporary targets can remain in memory for a specific set of options
  1148. renderManager.maxTempPerKey = 10 // default = 5
  1149. // Copy/Blit a texture to the canvas or another render target with standard or a custom material
  1150. renderManager.blit(destination, {source: sourceTexture})
  1151. // Clear color of the canvas
  1152. renderManager.clearColor({r: 0, g: 0, b: 0, a: 1, depth: true, viewport: new Vector4(...)})
  1153. // Clear of a render target
  1154. renderManager.clearColor(renderTarget, {r: 0, g: 0, b: 0, a: 1, target: renderTarget})
  1155. // Export a render target to a blob. The type is automatically picked from exr to png based on the render target
  1156. const blob = renderManager.exportRenderTarget(renderTarget, 'auto')
  1157. // Export a render target to png/jpeg data url. This will clamp any floating point targets to fit in png/jpeg
  1158. const dataUrl = renderManager.renderTargetToDataUrl(renderTarget, 'image/png')
  1159. // Read render target pixels to array buffer. Returns Uint8Array|Uint16Array|Float32Array based on the render target type
  1160. const buffer = renderManager.renderTargetToBuffer(renderTarget)
  1161. ```
  1162. [`renderManager.composer`](https://threepipe.org/docs/classes/ViewerRenderManager.html#composer) - The three.js [EffectComposer](https://threejs.org/docs/#api/en/postprocessing/EffectComposer) used for rendering the pipeline.
  1163. [`renderManager.renderer`](https://threepipe.org/docs/classes/ViewerRenderManager.html#renderer) - The three.js [WebGLRenderer](https://threejs.org/docs/#api/en/renderers/WebGLRenderer) used for rendering
  1164. [`renderManager.context`](https://threepipe.org/docs/classes/ViewerRenderManager.html#context) - Access the WebGL rendering context for the canvas.
  1165. [`renderManager.renderPass`](https://threepipe.org/docs/classes/ViewerRenderManager.html#renderPass) - The main render pass used in the render pipeline. Instance of three.js [RenderPass](https://threejs.org/docs/#api/en/postprocessing/RenderPass) with extra features like z prepass, rgbm rendering, blurred transmission, msaa and other optimizations.
  1166. [`renderManager.screenPass`](https://threepipe.org/docs/classes/ViewerRenderManager.html#screenPass) - The main screen pass used in the render pipeline. Instance of three.js [ShaderPass](https://threejs.org/docs/#api/en/postprocessing/ShaderPass) with extra features like material extension, custom fragment, overriding read buffer, re-render to screen on change, etc
  1167. [`renderManager.renderScale`](https://threepipe.org/docs/classes/RenderManager.html#renderScale) - Sets the render scale. All targets are scaled by this factor. This is equivalent to calling `EffectComposer.setPixelRatio` and `WebGLRenderer.setPixelRatio` in three.js.
  1168. [`renderManager.resetShadows`](https://threepipe.org/docs/classes/RenderManager.html#resetShadows) - Resets all shadow maps in the scene. This is useful when some object is moved and the shadows need to be updated. This is automatically called when `scene.setDirty` or any `object.setDirty` is called, and during animation with plugins.
  1169. ### Rendering Pipeline
  1170. [`renderManager.registerPass`](https://threepipe.org/docs/classes/RenderManager.html#registerPass) - Registers a custom composer pass to the render pipeline. See [IPipelinePass](https://threepipe.org/docs/interfaces/IPipelinePass.html) interface.
  1171. [`renderManager.unregisterPass`](https://threepipe.org/docs/classes/RenderManager.html#unregisterPass) - Unregisters a custom composer pass from the render pipeline.
  1172. [`renderManager.pipeline`](https://threepipe.org/docs/classes/RenderManager.html#pipeline) - The render pipeline array. The array is automatically sorted based on dependencies in the pipeline passes.
  1173. [`renderManager.autoBuildPipeline`](https://threepipe.org/docs/classes/RenderManager.html#autoBuildPipeline) - If `true`, the pipeline is automatically created and sorted based on dependencies in pipeline pass. If `false`, the pipeline is built only once and is not changed after that. The default value is `true`.
  1174. [`renderManager.totalFrameCount`](https://threepipe.org/docs/classes/RenderManager.html#totalFrameCount) - The total frames rendered since the render manager was created.
  1175. [`renderManager.frameCount`](https://threepipe.org/docs/classes/RenderManager.html#frameCount) - The current frame count in progressive rendering. This is useful for progressive rendering effects like progressive shadows, gi, denoising, baking, anti-aliasing, and many other effects.
  1176. ### Render Targets management
  1177. [`renderManager.composerTarget`](https://threepipe.org/docs/classes/RenderManager.html#composerTarget), [`renderManager.composerTarget1`](https://threepipe.org/docs/classes/RenderManager.html#composerTarget1) - The main targets used in [EffectComposer2](https://threepipe.org/docs/classes/EffectComposer2)
  1178. [`renderManager.createTarget`](https://threepipe.org/docs/classes/RenderTargetManager.html#createTarget) - Creates a render target with the given options. The render target is automatically resized when the canvas is resized if `sizeMultiplier` is used. See [CreateRenderTargetOptions](https://threepipe.org/docs/interfaces/CreateRenderTargetOptions.html) for options
  1179. [`renderManager.disposeTarget`](https://threepipe.org/docs/classes/RenderTargetManager.html#disposeTarget) - Disposes a render target and removes it from the render target manager.
  1180. [`renderManager.getTempTarget`](https://threepipe.org/docs/classes/RenderTargetManager.html#getTempTarget) - Gets a temporary render target with the given options. The render target is automatically resized when the canvas is resized if `sizeMultiplier` is used. See [CreateRenderTargetOptions](https://threepipe.org/docs/interfaces/CreateRenderTargetOptions.html) for options
  1181. [`renderManager.releaseTempTarget`](https://threepipe.org/docs/classes/RenderTargetManager.html#releaseTempTarget) - Releases a temporary render target and adds it back to the render target manager.
  1182. [`renderManager.maxTempPerKey`](https://threepipe.org/docs/classes/RenderTargetManager.html#maxTempPerKey) - Sets how many temporary targets can remain in memory for a specific set of options. The default value is `5`.
  1183. ### Helpers
  1184. [`renderManager.blit`](https://threepipe.org/docs/classes/RenderManager.html#blit) - Blits a texture to the canvas or another render target with standard or a custom material. See [RendererBlitOptions](https://threepipe.org/docs/interfaces/RendererBlitOptions.html) for options.
  1185. [`renderManager.clearColor`](https://threepipe.org/docs/classes/RenderManager.html#clearColor) - Clears the color of the canvas or a render target.
  1186. [`renderManager.exportRenderTarget`](https://threepipe.org/docs/classes/RenderManager.html#exportRenderTarget) - Exports a render target to a blob. The type is automatically picked from exr to png based on the render target.
  1187. [`renderManager.renderTargetToDataUrl`](https://threepipe.org/docs/classes/RenderManager.html#renderTargetToDataUrl) - Exports a render target to png/jpeg data url string. This will clamp any floating point targets to fit in png/jpeg. See [RenderTargetToDataUrlOptions](https://threepipe.org/docs/interfaces/RenderTargetToDataUrlOptions.html) for options.
  1188. [`renderManager.renderTargetToBuffer`](https://threepipe.org/docs/classes/RenderManager.html#renderTargetToBuffer) - Reads render target pixels to a Uint8Array|Uint16Array|Float32Array array buffer.
  1189. ## RootScene
  1190. Source Code: [src/core/object/RootScene.ts](./src/core/object/RootScene.ts)
  1191. API Reference: [RootScene](https://threepipe.org/docs/classes/RootScene.html)
  1192. RootScene is the main scene that is rendered in the canvas.
  1193. It is an instance of three.js [Scene](https://threejs.org/docs/#api/en/scenes/Scene) with extra features including separation between model root and others,
  1194. backgroundColor, background map and background intensity,
  1195. environment map rotation and intensity, fixed env map direction patch, event bubbling in the scene hierarchy, scene config serialization, main camera management,
  1196. automatic active near far management based on scene bounds, disposing complete scene hierarchy, etc
  1197. ```typescript
  1198. const viewer = new ThreeViewer({...})
  1199. const scene = viewer.scene
  1200. // List oll loaded objects in the model root
  1201. console.log(scene.modelRoot.children)
  1202. // Set the background color
  1203. scene.setBackgroundColor('#ffffff')
  1204. // or
  1205. // scene.backgroundColor = new Color('#ffffff')
  1206. // or
  1207. // scene.backgroundColor.set('#ffffff')
  1208. // scene.onBackgroundChange() // this must be called when not using a setter or set function.
  1209. // Set a texture as background (or use viewer.setBackgroundMap). When both color and texture are set, they are multiplied
  1210. scene.background = customTexture
  1211. // Set the background same as the environment map
  1212. scene.background = 'environment' // background is automatically changed when the environment changes.
  1213. // or
  1214. // scene.background = scene.environment
  1215. // Set the background intensity
  1216. scene.backgroundIntensity = 2
  1217. // Set a texture as environment map (or use viewer.setEnvironmentMap)
  1218. scene.environment = customTexture
  1219. // Set the environment intensity
  1220. scene.envMapIntensity = 2
  1221. // Set the environment map rotation
  1222. scene.environment.rotation = Math.PI / 2
  1223. // Set Fixed env direction (rotate environment according the the camera)
  1224. scene.fixedEnvMapDirection = true
  1225. // Get the main camera used for rendering
  1226. const camera: PerspectiveCamera2 = scene.mainCamera
  1227. // Set camera props
  1228. camera.position.set(0, 0, 10)
  1229. camera.target.set(0, 0, 0)
  1230. camera.setDirty() // this needs to be called to notify the viewer to re-render the scene
  1231. // Traverse the model root hierarchy (or just use viewer.traverseSceneObjects)
  1232. scene.modelRoot.traverse((object) => {
  1233. console.log(object)
  1234. // do something with object
  1235. })
  1236. // Access the default camera (same as mainCamera if not changed explicitly)
  1237. const defaultCamera: ICamera = scene.defaultCamera
  1238. // Dispose all assets in the modelRoot
  1239. scene.disposeSceneModels()
  1240. // Remove all objects from the modelRoot
  1241. scene.clearSceneModels()
  1242. // Dispose the scene and all its resources and children
  1243. scene.dispose()
  1244. // Get bounds of the scene model root
  1245. const bounds = scene.getBounds(true, true) // true for precise bounds and ignore invisible
  1246. // Add an object to the scene or its model root depending on the options (or just use viewer.addSceneObject)
  1247. scene.addObject(object, {addToRoot: false}) // adds to the scene directly when addToRoot is true
  1248. // Load an imported model root from the asset importer
  1249. scene.loadModelRoot(object)
  1250. // notify that something has changed in the scene for re-render
  1251. scene.setDirty()
  1252. // notify that some object has changed in the scene for scene refresh(like shadow refresh, ground etc) and re-render
  1253. scene.refreshScene()
  1254. // or
  1255. scene.setDirty({refreshScene: true})
  1256. // set geometryChanged: false to prevent shadow recompute
  1257. scene.refreshScene({geometryChanged: false})
  1258. // refresh active near far. (in most cases this is done automatically and need not be called)
  1259. scene.refreshActiveNearFar()
  1260. ```
  1261. [`scene.modelRoot`](https://threepipe.org/docs/classes/RootScene.html#modelRoot) - The root object. All the objects loaded in the viewer are added to this object. And this is exported when exporting the gltf. Everything else like meta or UI objects can be added outside this.
  1262. [`scene.backgroundColor`](https://threepipe.org/docs/classes/RootScene.html#backgroundColor) - The background color of the scene. Can be a `Color | null`. This is not the same as `scene.background`. When both backgroundColor and background are set, they are multiplied.
  1263. [`scene.background`](https://threepipe.org/docs/classes/RootScene.html#background) - The background of the scene. This is the same as `scene.background` in three.js. This can be a texture or a color or null, but it's preferred to use `scene.backgroundColor` for color, and this for texture, then both can be used together.
  1264. [`scene.setBackgroundColor`](https://threepipe.org/docs/classes/RootScene.html#setBackgroundColor) - Set the background color from a string, number or color. Same as setting `backgroundColor` to a new color value.
  1265. [`scene.backgroundIntensity`](https://threepipe.org/docs/classes/RootScene.html#backgroundIntensity) - The background intensity of the scene. This is the same as `scene.backgroundIntensity` in three.js.
  1266. [`scene.environment`](https://threepipe.org/docs/classes/RootScene.html#environment) - The environment map of the scene. This is the same as `scene.environment` in three.js.
  1267. `scene.environment.rotation` - The rotation of the environment map around the y-axis.
  1268. [`scene.envMapIntensity`](https://threepipe.org/docs/classes/RootScene.html#envMapIntensity) - The environment intensity of the scene.
  1269. [`scene.fixedEnvMapDirection`](https://threepipe.org/docs/classes/RootScene.html#fixedEnvMapDirection) - If `true`, the environment map is rotated according to the camera. This is the same as `scene.fixedEnvMapDirection` in three.js.
  1270. [`scene.mainCamera`](https://threepipe.org/docs/classes/RootScene.html#mainCamera) - The main camera used for rendering. This is the same as `scene.mainCamera` in three.js.
  1271. [`scene.defaultCamera`](https://threepipe.org/docs/classes/RootScene.html#defaultCamera) - The default camera used for rendering. This is the same as `scene.defaultCamera` in three.js.
  1272. [`scene.disposeSceneModels`](https://threepipe.org/docs/classes/RootScene.html#disposeSceneModels) - Disposes all assets in the modelRoot.
  1273. [`scene.clearSceneModels`](https://threepipe.org/docs/classes/RootScene.html#clearSceneModels) - Removes all objects from the modelRoot.
  1274. [`scene.dispose`](https://threepipe.org/docs/classes/RootScene.html#dispose) - Disposes the scene and all its resources and children.
  1275. [`scene.getBounds`](https://threepipe.org/docs/classes/RootScene.html#getBounds) - Gets the bounds of the scene model root. Returns an instance of three.js [Box3](https://threejs.org/docs/#api/en/math/Box3) with min and max bounds according to parameters.
  1276. [`scene.addObject`](https://threepipe.org/docs/classes/RootScene.html#addObject) - Adds an object to the scene or its model root depending on the options. If `addToRoot` is `true`, the object is added to the model root, else it is added to the scene directly.
  1277. [`scene.setDirty`](https://threepipe.org/docs/classes/RootScene.html#setDirty) - Notifies that something has changed in the scene for re-render.
  1278. [`scene.refreshScene`](https://threepipe.org/docs/classes/RootScene.html#refreshScene) - Notifies that some object has changed in the scene for scene refresh(like shadow refresh, ground etc) and re-render. Slower than `setDirty`, as it refreshes shadows, updates bounds, etc.
  1279. [`scene.refreshActiveNearFar`](https://threepipe.org/docs/classes/RootScene.html#refreshActiveNearFar) - Refreshes active near far. (in most cases this is done automatically and need not be called)
  1280. [`scene.loadModelRoot`](https://threepipe.org/docs/classes/RootScene.html#loadModelRoot) - Loads an imported model root from the asset importer. This is used internally and in most cases, you don't need to call this.
  1281. ### Scene Events
  1282. RootScene dispatches many events that are useful when writing app logic or plugins
  1283. `'sceneUpdate'` - Listen to `refreshScene` called in RootScene. When some object changes.
  1284. `'addSceneObject'` - When a new object is added to the scene
  1285. `'mainCameraChange'` - When the main camera is changed to some other camera.
  1286. `'mainCameraUpdate'` - When some properties in the current main camera has changed.
  1287. `'environmentChanged'` - When the environment map changes
  1288. `'backgroundChanged'` - When the background map or color changes
  1289. `'materialUpdate`' - When a material in the scene has updated. (setDirty called on the material)
  1290. `'objectUpdate`' - When a object in the scene has updated. (setDirty called on the object)
  1291. `'textureUpdate`' - When a texture in the scene has updated. (setDirty called on the texture)
  1292. `'cameraUpdate`' - When a camera in the scene has updated.
  1293. (setDirty called on the camera)
  1294. `'geometryUpdate`' - When a geometry in the scene has updated.
  1295. (setDirty called on the geometry)
  1296. `'geometryChanged`' - When a geometry is changed on any mesh
  1297. `'materialChanged'` - When a material is changed on any mesh
  1298. Check [IObject3DEventTypes](https://threepipe.org/docs/interfaces/IObject3DEventTypes.html) and[ISceneEventTypes](https://threepipe.org/docs/interfaces/ISceneEventTypes.html) for more information.
  1299. ## ICamera
  1300. Source Code: [src/core/camera/PerspectiveCamera2.ts](./src/core/camera/PerspectiveCamera2.ts), [src/core/ICamera.ts](./src/core/ICamera.ts)
  1301. API Reference: [PerspectiveCamera2](https://threepipe.org/docs/classes/PerspectiveCamera2.html), [ICamera](https://threepipe.org/docs/interfaces/ICamera.html)
  1302. ICamera is an interface for a camera that extends the three.js [Camera](https://threejs.org/docs/#api/en/cameras/Camera).
  1303. PerspectiveCamera2 implements the interface,
  1304. extending from three.js [PerspectiveCamera](https://threejs.org/docs/#api/en/cameras/PerspectiveCamera) with extra features like target, automatic aspect management, automatic near far management(from RootScene), camera control attachment and hooks(like OrbitControls) and the ability to set as the main camera in the root scene.
  1305. ```typescript
  1306. import {OrbitControls3} from './OrbitControls3'
  1307. const viewer = new ThreeViewer({...})
  1308. const camera: PerspectiveCamera2 = viewer.scene.mainCamera
  1309. // Set the camera position
  1310. camera.position.set(0, 0, 10)
  1311. // Set the camera target (where the camera looks at)
  1312. camera.target.set(0, 0, 0)
  1313. // Set the camera fov
  1314. camera.fov = 45
  1315. // Set the camera aspect ratio
  1316. camera.autoAspect = false // disable automatic aspect management based on the canvas size
  1317. camera.aspect = 1
  1318. // Set camera near far bounds.
  1319. // Near, Far plane will be calculated automatically within these limits
  1320. // Try changing these values when encountering z-fighting issues or far-plane clipping
  1321. camera.minNearPlane = 0.5 // min near plane
  1322. camera.maxFarPlane = 10 // max far plane
  1323. // Set a custom camera near far
  1324. camera.autoNearFar = false // disable automatic near far management based on the scene bounds
  1325. camera.minNearPlane = 0.1 // near plane
  1326. camera.maxFarPlane = 1000 // far plane
  1327. // this needs to be called to notify the viewer to re-render the scene
  1328. // in most cases this is done internally. But calling this does not have much impact
  1329. camera.setDirty()
  1330. // Check if user can interact with the camera. Also checks if its the main camera.
  1331. console.log(camera.canUserInteract)
  1332. // Get the camera controls (orbit controls for the default camera)
  1333. const controls: OrbitControls3 = camera.controls
  1334. // Disable controls
  1335. controls.enabled = false
  1336. // Change the controls mode
  1337. camera.controlsMode = 'none' // this will remove the current controls.
  1338. // Register a custom camera controls
  1339. camera.setControlsCtor('customOrbit', (camera, domElement) => new CustomOrbitControls(camera, domElement))
  1340. // Set the camera controls
  1341. camera.controlsMode = 'customOrbit' // this will initialize the controls with the customOrbit constructor and set it on the camera
  1342. // Disable interactions to the camera. (eg when animating)
  1343. camera.setInteractions(false, 'animation')
  1344. // Enable interactions back
  1345. camera.setInteractions(true, 'animation') // this will enable interactions when all the keys have been set to true(which were set to false earlier)
  1346. // Force refresh aspect ratio (this is done automatically with a ResizeObserver on the canvas in the viewer)
  1347. camera.refreshAspect()
  1348. // Set the camera as the main camera
  1349. camera.activateMain()
  1350. // Deactivate the camera as the main camera
  1351. camera.deactivateMain()
  1352. ```
  1353. [`camera.target`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#target) - The target of the camera. This is the same as `controls.target` in three.js. The target is always in world-space coordinates, as opposed to position, rotation, and scale which are always relative to their parent.
  1354. [`camera.autoAspect`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#autoAspect) - If `true`, the aspect ratio is automatically calculated based on the canvas size.
  1355. [`camera.aspect`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#aspect) - The aspect ratio of the camera. This is the same as `camera.aspect` in three.js. This is only used when `camera.autoAspect` is `false`.
  1356. [`camera.minNearPlane`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#minNearPlane) - The minimum near plane of the camera. This is the same as `camera.near` in three.js when `camera.autoNearFar` is `false`, otherwise it is the minimum near plane distance from the camera allowed when computing automatically
  1357. [`camera.maxFarPlane`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#maxFarPlane) - The maximum far plane of the camera. This is the same as `camera.far` in three.js when `camera.autoNearFar` is `false`, otherwise it is the maximum far plane distance from the camera allowed when computing automatically
  1358. [`camera.autoNearFar`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#autoNearFar) - If `true` (default), the near and far planes are automatically calculated based on the scene bounds.
  1359. [`camera.setDirty`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#setDirty) - Notifies that something has changed in the camera for re-render.
  1360. [`camera.canUserInteract`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#canUserInteract) - Checks if user can interact with the camera. Also checks if it's the main camera.
  1361. [`camera.controls`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#controls) - Get the current camera controls set on the camera. This can be changed by changing `controlsMode`
  1362. [`camera.controlsMode`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#controlsMode) - Get or set the current controls that are attached to the camera. More modes can be registered with `setControlsCtor`. Default for the default camera is `orbit` and `none` for any new cameras.
  1363. [`camera.setControlsCtor`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#setControlsCtor) - Register a custom camera controls constructor. The controls can be set by setting `controlsMode` to the key/name of the controls.
  1364. [`camera.setInteractions`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#setInteractions) - If `true`, the camera can be interacted with. This is useful when animating the camera or using the window scroll or programmatically automating the viewer. Using this multiple plugins can disable interactions and it will be enabled again when all of them enable it back.
  1365. [`camera.refreshAspect`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#refreshAspect) - Force refresh aspect ratio (this is done automatically with a ResizeObserver on the canvas in the viewer or when `viewer.resize()` is called)
  1366. [`camera.activateMain`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#activateMain) - Set the camera as the main camera. This is the same as doing `scene.mainCamera = camera`. The camera needs to be in the scene hierarchy for this to work.
  1367. [`camera.deactivateMain`](https://threepipe.org/docs/classes/PerspectiveCamera2.html#deactivateMain) - Deactivate the camera as the main camera.
  1368. See also [CameraViewPlugin](#cameraviewplugin) for camera focus animation.
  1369. ## AssetManager
  1370. Source Code: [src/assetmanager/AssetManager.ts](./src/assetmanager/AssetManager.ts)
  1371. API Reference: [AssetManager](https://threepipe.org/docs/classes/AssetManager.html)
  1372. `AssetManager` is a class that manages the loading and exporting of assets and provides helpers for caching assets. It is used internally in the viewer and can be used to load assets outside the viewer. It provides a modular framework for adding more asset loaders and exporters.
  1373. ```typescript
  1374. const viewer = new ThreeViewer({...})
  1375. const assetManager = viewer.assetManager
  1376. // Add an asset or an asset bundle
  1377. const assets = await assetManager.addAsset('https://example.com/model.zip')
  1378. // or
  1379. const assets = await assetManager.addAsset({
  1380. path: 'https://example.com/model.zip',
  1381. file: blob,
  1382. })
  1383. // Get the storage used in the asset manager for caching
  1384. const storage: Cache | Storage = assetManager.storage
  1385. // Get the importer. Provides low level functions to import assets
  1386. const importer = assetManager.importer
  1387. // import a file by asset or url
  1388. const file = await importer.import('https://example.com/model.gltf')
  1389. // Import a Map<string, File> from drag drop
  1390. const res = await importer.importFiles(mapOfFiles, {})
  1391. // Register a custom path that maps to a File object. Useful when some file types have path references to other files.
  1392. importer.registerFile('/myFile.png', file) // this returns the three.js loader for that kind of file.
  1393. // Unregister the path
  1394. importer.unregisterFile('/myFile.png')
  1395. // Unregister all files and clear the loader cache(memory, not storage)
  1396. importer.clearCache()
  1397. // Add custom importers (check extra load plugins for more examples)
  1398. importer.addImporter(new Importer(class extends PLYLoader implements ILoader {
  1399. transform(res: BufferGeometry, _: AnyOptions): Mesh | undefined {
  1400. return res ? new Mesh(res, new PhysicalMaterial({color: new Color(1, 1, 1)})) : undefined
  1401. }
  1402. }, ['ply'], ['text/plain+ply'], false))
  1403. // Get the exporter. Provides low level functions to export assets
  1404. const exporter = assetManager.exporter
  1405. // Export any IObject3D, IMaterial, ITexture, IRenderTarget
  1406. const exported = exporter.exportObject(obj, options)
  1407. // Add a custom exporter
  1408. exporter.addExporter({
  1409. ext: ['gltf', 'glb'], // file extensions
  1410. extensions: [], // extensions for the exporter
  1411. ctor: (assetExporter, iexporter) => {
  1412. return new GLTFExporter2()
  1413. }
  1414. })
  1415. // Material Manager
  1416. const materialManager = assetManager.materialManager
  1417. // Create a material of type
  1418. const mat = materialManager.create('physical')
  1419. const mat2 = materialManager.create('unlit')
  1420. // find or create a material by uuid
  1421. const mat = materialManager.findOrCreate('00000000-0000-0000-0000-000000000000', {color: '#ffffff'})
  1422. // find a material creation template
  1423. const template = materialManager.findTemplate('physical')
  1424. // Get all materials
  1425. const materials = materialManager.getAllMaterials()
  1426. // Get all materials of type
  1427. const materials = materialManager.getMaterialsOfType(PhysicalMaterial.TypeSlug)
  1428. // register a custom material to the manager for tracking and extensions
  1429. // Note all materials created in threepipe internally are registered automatically on creation or when added to any scene object.
  1430. materialManager.registerMaterial(customMat)
  1431. // unregister
  1432. materialManager.unregisterMaterial(customMat)
  1433. // clear all material references
  1434. materialManager.clearMaterials()
  1435. // Register a custom material template
  1436. materialManager.registerTemplate({
  1437. generator: (params: any) => new PhysicalMaterial(params),
  1438. name: 'custom',
  1439. materialType: PhysicalMaterial.TYPE,
  1440. params: {
  1441. color: '#ffffff',
  1442. roughness: 0.5,
  1443. metalness: 0.5,
  1444. },
  1445. })
  1446. const mat3 = materialManager.create('custom')
  1447. // convert a standard three.js material to threepipe material
  1448. const mat4 = materialManager.convertToIMaterial(new ShadowMaterial(), {materialTemplate: 'test'})
  1449. // register a custom material extension for all materials in the viewer
  1450. materialManager.registerMaterialExtension(customExtension)
  1451. // unregister
  1452. materialManager.unregisterMaterialExtension(customExtension)
  1453. // remove all extensions
  1454. materialManager.clearExtensions()
  1455. // Apply a material properties to other material(s) in the scene by name or uuid
  1456. materialManager.applyMaterial(goldMaterial, 'METAL') // this will copy the properties from goldMaterial to all the materials(or objects) in the viewer with the name METAL.
  1457. // export a material as JSON. Note: use AssetExporter instead to export all the embedded assets and properties properly.
  1458. const blob = materialManager.exportMaterial(mat)
  1459. // dispose manager and all materials.
  1460. materialManager.dispose()
  1461. ```
  1462. [`assetManager.addAsset`](https://threepipe.org/docs/classes/AssetManager.html#addAsset) - Add an asset or an asset bundle. Returns a promise that resolves to an array of asset objects. An asset can contain multiple objects, hence an array is returned. Use shorthand `viewer.load(path)` to load a single asset from a single file.
  1463. [`assetManager.storage`](https://threepipe.org/docs/classes/AssetManager.html#storage) - Get the storage used in the asset manager for caching. This is the storage that can be passed in the `ThreeViewer` contructor options.
  1464. [`assetManager.importer`](https://threepipe.org/docs/classes/AssetManager.html#importer) - Get the importer. Provides low-level functions to import assets. This is an instance of [AssetImporter](https://threepipe.org/docs/classes/AssetImporter.html).
  1465. [`assetManager.exporter`](https://threepipe.org/docs/classes/AssetManager.html#exporter) - Get the exporter. Provides low-level functions to export assets. This is an instance of [AssetExporter](https://threepipe.org/docs/classes/AssetExporter.html).
  1466. ### AssetImporter
  1467. [`importer.import`](https://threepipe.org/docs/classes/AssetImporter.html#import) - Import a file by asset or url. Returns a promise that resolves to a [File](https://threepipe.org/docs/classes/File.html) object.
  1468. [`importer.importFiles`](https://threepipe.org/docs/classes/AssetImporter.html#importFiles) - Import a Map<string, File> from drag and drop. Returns a promise that resolves to a Map<string, any[]> of imported object arrays.
  1469. [`importer.registerFile`](https://threepipe.org/docs/classes/AssetImporter.html#registerFile) - Register a custom path that maps to a File object. Useful when some file types have path references to other files. Like when importing a .zip with a .gltf file that references a .bin file, or when loading remote files from custom local cache implementation.
  1470. [`importer.unregisterFile`](https://threepipe.org/docs/classes/AssetImporter.html#unregisterFile) - Unregister the path.
  1471. [`importer.clearCache`](https://threepipe.org/docs/classes/AssetImporter.html#clearCache) - Unregister all the registered files and clear the loader cache(memory cache, not cache-storage).
  1472. [`importer.addImporter`](https://threepipe.org/docs/classes/AssetImporter.html#addImporter) - Add custom importers (check extra load plugins for more examples). This allows to pass a class to a ILoader, that is used to import assets. Loaders are only created when a file is being loaded of that type. And they remain in the loader cache until `clearCache` or `clearLoaderCache` is called.
  1473. ### AssetExporter
  1474. [`exporter.exportObject`](https://threepipe.org/docs/classes/AssetExporter.html#exportObject) - Export any IObject3D, IMaterial, ITexture, IRenderTarget. Returns a promise that resolves to an exported object. Use `viewer.export` or `AssetExporterPlugin`, which provide more features and shortcuts to export viewer, scene and plugins as well.
  1475. [`exporter.addExporter`](https://threepipe.org/docs/classes/AssetExporter.html#addExporter) - Add a custom exporter for a custom file type.
  1476. ### MaterialManager
  1477. [`materialManager.create`](https://threepipe.org/docs/classes/MaterialManager.html#create) - Create a new material of a given type and with passed properties. Returns an implementation of [IMaterial](https://threepipe.org/docs/interfaces/IMaterial.html).
  1478. [`materialManager.findOrCreate`](https://threepipe.org/docs/classes/MaterialManager.html#findOrCreate) - Find or create a material by uuid. Returns an instance of [IMaterial](https://threepipe.org/docs/interfaces/IMaterial.html). If a material with the uuid exists, it is returned, else a new material is created with the passed properties.
  1479. [`materialManager.findTemplate`](https://threepipe.org/docs/classes/MaterialManager.html#findTemplate) - Find a material creation template. Returns an instance of [IMaterialTemplate](https://threepipe.org/docs/interfaces/IMaterialTemplate.html). Material templates are used to create materials of a given type with default properties.
  1480. [`materialManager.getAllMaterials`](https://threepipe.org/docs/classes/MaterialManager.html#getAllMaterials) - Get all materials registered with the manager.
  1481. [`materialManager.getMaterialsOfType`](https://threepipe.org/docs/classes/MaterialManager.html#getMaterialsOfType) - Get all materials of a specific type. Pass in the typeslug from the class like `pmat` or `dmat` to identify the material.
  1482. [`materialManager.registerMaterial`](https://threepipe.org/docs/classes/MaterialManager.html#registerMaterial) - Register a new material to the manager for tracking and extensions. Note: all materials created in threepipe internally or any that are set to any object in the scene are registered automatically on creation or when used
  1483. [`materialManager.unregisterMaterial`](https://threepipe.org/docs/classes/MaterialManager.html#unregisterMaterial) - Unregister a material from the manager.
  1484. [`materialManager.clearMaterials`](https://threepipe.org/docs/classes/MaterialManager.html#clearMaterials) - Clear all registered material references.
  1485. [`materialManager.registerTemplate`](https://threepipe.org/docs/classes/MaterialManager.html#registerTemplate) - Register a custom material template. Requires an instance of [IMaterialTemplate](https://threepipe.org/docs/interfaces/IMaterialTemplate.html). Material templates are used to create materials of a given type with default properties.
  1486. [`materialManager.convertToIMaterial`](https://threepipe.org/docs/classes/MaterialManager.html#convertToIMaterial) - Convert/upgrade a standard three.js material to threepipe material, by making it conform to [IMaterial](https://threepipe.org/docs/interfaces/IMaterial.html).
  1487. [`materialManager.registerMaterialExtension`](https://threepipe.org/docs/classes/MaterialManager.html#registerMaterialExtension) - Register a custom material extension for all materials in the viewer. Requires an instance of [IMaterialExtension](https://threepipe.org/docs/interfaces/IMaterialExtension.html). Material extensions are used to add custom properties, methods, uniforms, defines, shader patches etc to predefined materials. The extensions are added to the material when the mateiral or extension is registered to the manager.
  1488. [`materialManager.unregisterMaterialExtension`](https://threepipe.org/docs/classes/MaterialManager.html#unregisterMaterialExtension) - Unregister a material extension from the manager.
  1489. [`materialManager.clearExtensions`](https://threepipe.org/docs/classes/MaterialManager.html#clearExtensions) - Remove all material extensions from the manager.
  1490. [`materialManager.applyMaterial`](https://threepipe.org/docs/classes/MaterialManager.html#applyMaterial) - Apply a material properties to other material(s) in the scene by name or uuid. This is useful when you want to change the properties of all materials with a given name or uuid. This can also be a regex, in that case a regex.match will be performed on the material/object name.
  1491. [`materialManager.exportMaterial`](https://threepipe.org/docs/classes/MaterialManager.html#exportMaterial) - Export a material as JSON. Note: use `viewer.export` or `AssetExporter` instead to export all the embedded assets properly.
  1492. [`materialManager.dispose`](https://threepipe.org/docs/classes/MaterialManager.html#dispose) - Dispose manager and all materials.
  1493. # Threepipe Plugins
  1494. ThreePipe has a simple plugin system that allows you to easily add new features to the viewer. Plugins can be added to the viewer using the `addPlugin` and `addPluginSync` methods. The plugin system is designed to be modular and extensible. Plugins can be added to the viewer at any time and can be removed using the `removePlugin` and `removePluginSync` methods.
  1495. ## TonemapPlugin
  1496. [//]: # (todo: image)
  1497. [Example](https://threepipe.org/examples/#tonemap-plugin/) &mdash;
  1498. [Source Code](./src/plugins/postprocessing/TonemapPlugin.ts) &mdash;
  1499. [API Reference](https://threepipe.org/docs/classes/TonemapPlugin.html)
  1500. TonemapPlugin adds a post-processing material extension to the ScreenPass in render manager
  1501. that applies tonemapping to the color. The tonemapping operator can be changed
  1502. by setting the `toneMapping` property of the plugin. The default tonemapping operator is `ACESFilmicToneMapping`.
  1503. Other Tonemapping properties can be like `exposure`, `contrast` and `saturation`
  1504. TonemapPlugin is added by default in ThreeViewer unless `tonemap` is set to `false` in the options.
  1505. ## DropzonePlugin
  1506. [//]: # (todo: image)
  1507. [Example](https://threepipe.org/examples/#dropzone-plugin/) &mdash;
  1508. [Source Code](./src/plugins/interaction/DropzonePlugin.ts) &mdash;
  1509. [API Reference](https://threepipe.org/docs/classes/DropzonePlugin.html)
  1510. DropzonePlugin adds support for drag and drop of local files to automatically import, process and load them into the viewer.
  1511. DropzonePlugin can be added by default in ThreeViewer
  1512. by setting the `dropzone` property to `true` or an object of `DropzonePluginOptions` in the options.
  1513. ```typescript
  1514. import {DropzonePlugin, ThreeViewer} from 'threepipe'
  1515. const viewer = new ThreeViewer({
  1516. canvas: document.getElementById('mcanvas') as HTMLCanvasElement,
  1517. dropzone: true, // just set to true to enable drag drop functionatility in the viewer
  1518. })
  1519. ```
  1520. To set custom options,
  1521. pass an object of [DropzonePluginOptions](https://threepipe.org/docs/interfaces/DropzonePluginOptions.html) type to the `dropzone` property.
  1522. ```typescript
  1523. import {DropzonePlugin, ThreeViewer} from 'threepipe'
  1524. const viewer = new ThreeViewer({
  1525. canvas: document.getElementById('mcanvas') as HTMLCanvasElement,
  1526. dropzone: { // this can also be set to true and configured by getting a reference to the DropzonePlugin
  1527. allowedExtensions: ['gltf', 'glb', 'hdr', 'png', 'jpg', 'json', 'fbx', 'obj', 'bin', 'exr'], // only allow these file types. If undefined, all files are allowed.
  1528. addOptions: {
  1529. disposeSceneObjects: true, // auto dispose of old scene objects
  1530. autoSetEnvironment: true, // when hdr is dropped
  1531. autoSetBackground: true, // when any image is dropped
  1532. autoCenter: true, // auto center the object
  1533. autoScale: true, // auto scale according to radius
  1534. autoScaleRadius: 2,
  1535. license: 'Imported from dropzone', // Any license to set on imported objects
  1536. importConfig: true, // import config from file
  1537. },
  1538. // check more options in the DropzonePluginOptions interface
  1539. },
  1540. })
  1541. ```
  1542. ## ProgressivePlugin
  1543. [//]: # (todo: image)
  1544. [Example](https://threepipe.org/examples/#progressive-plugin/) &mdash;
  1545. [Source Code](./src/plugins/pipeline/ProgressivePlugin.ts) &mdash;
  1546. [API Reference](https://threepipe.org/docs/classes/ProgressivePlugin.html)
  1547. Progressive Plugin adds a post-render pass to blend the last frame with the current frame.
  1548. This is used as a dependency in other plugins for progressive rendering effect which is useful for progressive shadows, gi, denoising, baking, anti-aliasing, and many other effects.
  1549. ## DepthBufferPlugin
  1550. [//]: # (todo: image)
  1551. [Example](https://threepipe.org/examples/#depth-buffer-plugin/) &mdash;
  1552. [Source Code](./src/plugins/pipeline/DepthBufferPlugin.ts) &mdash;
  1553. [API Reference](https://threepipe.org/docs/classes/DepthBufferPlugin.html)
  1554. Depth Buffer Plugin adds a pre-render pass to the render manager and renders a depth buffer to a target. The render target can be accessed by other plugins throughout the rendering pipeline to create effects like depth of field, SSAO, SSR, etc.
  1555. ```typescript
  1556. import {ThreeViewer, DepthBufferPlugin} from 'threepipe'
  1557. const viewer = new ThreeViewer({...})
  1558. const depthPlugin = viewer.addPluginSync(new DepthBufferPlugin(HalfFloatType))
  1559. const depthTarget = depthPlugin.target;
  1560. // Use the depth target by accesing `depthTarget.texture`.
  1561. ```
  1562. The depth values are based on camera near far values, which are controlled automatically by the viewer. To manually specify near, far values and limits, it can be set in the camera userData. Check the [example](https://threepipe.org/examples/#depth-buffer-plugin/) for more details.
  1563. ## NormalBufferPlugin
  1564. [//]: # (todo: image)
  1565. [Example](https://threepipe.org/examples/#normal-buffer-plugin/) &mdash;
  1566. [Source Code](./src/plugins/pipeline/NormalBufferPlugin.ts) &mdash;
  1567. [API Reference](https://threepipe.org/docs/classes/NormalBufferPlugin.html)
  1568. Normal Buffer Plugin adds a pre-render pass to the render manager and renders a normal buffer to a target. The render target can be accessed by other plugins throughout the rendering pipeline to create effects like SSAO, SSR, etc.
  1569. Note: Use [`DepthNormalBufferPlugin`](#DepthNormalBufferPlugin) if using both `DepthBufferPlugin` and `NormalBufferPlugin` to render both depth and normal buffers in a single pass.
  1570. ```typescript
  1571. import {ThreeViewer, NormalBufferPlugin} from 'threepipe'
  1572. const viewer = new ThreeViewer({...})
  1573. const normalPlugin = viewer.addPluginSync(new NormalBufferPlugin())
  1574. const normalTarget = normalPlugin.target;
  1575. // Use the normal target by accessing `normalTarget.texture`.
  1576. ```
  1577. ## GBufferPlugin
  1578. todo
  1579. ## PickingPlugin
  1580. [//]: # (todo: image)
  1581. [Example](https://threepipe.org/examples/#picking-plugin/) &mdash;
  1582. [Source Code](./src/plugins/interaction/PickingPlugin.ts) &mdash;
  1583. [API Reference](https://threepipe.org/docs/classes/PickingPlugin.html)
  1584. Picking Plugin adds support for selecting and hovering over objects in the viewer with user interactions and selection widgets.
  1585. When the plugin is added to the viewer, it starts listening to the mouse move and click events over the canvas.
  1586. When an object is clicked, it is selected,
  1587. and if a UI plugin is added, the uiconfig for the selected object is populated in the interface.
  1588. The events `selectedObjectChanged`, `hoverObjectChanged`, and `hitObject` can be listened to on the plugin.
  1589. Picking plugin internally uses [ObjectPicker](https://threepipe.org/docs/classes/ObjectPicker.html),
  1590. check out the documentation or source code for more information.
  1591. ```typescript
  1592. import {ThreeViewer, PickingPlugin} from 'threepipe'
  1593. const viewer = new ThreeViewer({...})
  1594. const pickingPlugin = viewer.addPluginSync(new PickingPlugin())
  1595. // Hovering events are also supported, but since its computationally expensive for large scenes it is disabled by default.
  1596. pickingPlugin.hoverEnabled = true
  1597. pickingPlugin.addEventListener('hitObject', (e)=>{
  1598. // This is fired when the user clicks on the canvas.
  1599. // The selected object hasn't been changed yet, and we have the option to change it or disable selection at this point.
  1600. // e.intersects.selectedObject contains the object that the user clicked on.
  1601. console.log('Hit: ', e.intersects.selectedObject)
  1602. // It can be changed here
  1603. // e.intersects.selectedObject = e.intersects.selectedObject.parent // select the parent
  1604. // e.intersects.selectedObject = null // unselect
  1605. // Check other properties on the event like intersects, mouse position, normal etc.
  1606. console.log(e)
  1607. })
  1608. pickingPlugin.addEventListener('selectedObjectChanged', (e)=>{
  1609. // This is fired when the selected object is changed.
  1610. // e.object contains the new selected object. It can be null if nothing is selected.
  1611. console.log('Selected: ', e.object)
  1612. })
  1613. // Objects can be programmatically selected and unselected
  1614. // to select
  1615. pickingPlugin.setSelectedObject(object)
  1616. // get the selected object
  1617. console.log(pickingPlugin.getSelectedObject())
  1618. // to unselect
  1619. pickingPlugin.setSelectedObject(null)
  1620. // Select object with camera animation to the object
  1621. pickingPlugin.setSelectedObject(object, true)
  1622. pickingPlugin.addEventListener('hoverObjectChanged', (e)=>{
  1623. // This is fired when the hovered object is changed.
  1624. // e.object contains the new hovered object.
  1625. console.log('Hovering: ', e.object)
  1626. })
  1627. ```
  1628. ## TransformControlsPlugin
  1629. [//]: # (todo: image)
  1630. [Example](https://threepipe.org/examples/#transform-controls-plugin/) &mdash;
  1631. [Source Code](./src/plugins/interaction/TransformControlsPlugin.ts) &mdash;
  1632. [API Reference](https://threepipe.org/docs/classes/TransformControlsPlugin.html)
  1633. Transform Controls Plugin adds support for moving, rotating and scaling objects in the viewer with interactive widgets.
  1634. Under the hood, TransformControlsPlugin uses [TransformControls2](https://threepipe.org/docs/classes/TransformControls2) to provide the interactive controls, it is a extended version of three.js [TransformControls](https://threejs.org/docs/#examples/en/controls/TransformControls).
  1635. When the plugin is added to the viewer, it interfaces with the [PickingPlugin](#pickingplugin) and shows the control gizmos when an object is selected and hides them when the object is unselected.
  1636. If the PickingPlugin is not added to the viewer before the TransformControlsPlugin, it is added automatically with the plugin.
  1637. ```typescript
  1638. import {ThreeViewer, TransformControlsPlugin} from 'threepipe'
  1639. const viewer = new ThreeViewer({...})
  1640. const transfromControlsPlugin = viewer.addPluginSync(new TransformControlsPlugin())
  1641. // Get the underlying transform controls
  1642. console.log(transfromControlsPlugin.transformControls)
  1643. ```
  1644. ## GLTFAnimationPlugin
  1645. [//]: # (todo: image)
  1646. [Example](https://threepipe.org/examples/#gltf-animation-plugin/) &mdash;
  1647. [Source Code](./src/plugins/animation/GLTFAnimationPlugin.ts) &mdash;
  1648. [API Reference](https://threepipe.org/docs/classes/GLTFAnimationPlugin.html)
  1649. Manages playback of GLTF animations.
  1650. The GLTF animations can be created in any 3d software that supports GLTF export like Blender.
  1651. If animations from multiple files are loaded, they will be merged in a single root object and played together.
  1652. The time playback is managed automatically, but can be controlled manually by setting {@link autoIncrementTime} to false and using {@link setTime} to set the time.
  1653. This plugin is made for playing, pausing, stopping, all the animations at once, while it is possible to play individual animations, it is not recommended.
  1654. To play individual animations, with custom choreography, use the {@link GLTFAnimationPlugin.animations} property to get reference to the animation clips and actions. Create your own mixers and control the animation playback like in three.js
  1655. ## PopmotionPlugin
  1656. [//]: # (todo: image)
  1657. [Example](https://threepipe.org/examples/#popmotion-plugin/) &mdash;
  1658. [Source Code](./src/plugins/animation/PopmotionPlugin.ts) &mdash;
  1659. [API Reference](https://threepipe.org/docs/classes/PopmotionPlugin.html)
  1660. Provides animation/tweening capabilities to the viewer using the [popmotion.io](https://popmotion.io/) library.
  1661. Overrides the driver in popmotion to sync with the viewer and provide ways to store and stop animations.
  1662. ```typescript
  1663. import {PopmotionPlugin, ThreeViewer} from 'threepipe'
  1664. const viewer = new ThreeViewer({...})
  1665. const cube = viewer.scene.getObjectByName('cube');
  1666. const popmotion = viewer.addPluginSync(new PopmotionPlugin())
  1667. // Move the object cube 1 unit up.
  1668. const anim = popmotion.animateTarget(cube, 'position', {
  1669. to: cube.position.clone().add(new Vector3(0,1,0)),
  1670. duration: 500, // ms
  1671. onComplete: () => isMovedUp = true,
  1672. onStop: () => throw(new Error('Animation stopped')),
  1673. })
  1674. // Alternatively, set the property directly in onUpdate.
  1675. const anim1 = popmotion.animate({
  1676. from: cube.position.y,
  1677. to: cube.position.y + 1,
  1678. duration: 500, // ms
  1679. onUpdate: (v) => {
  1680. cube.position.setY(v)
  1681. cube.setDirty()
  1682. },
  1683. onComplete: () => isMovedUp = true,
  1684. onStop: () => throw(new Error('Animation stopped')),
  1685. onEnd: () => console.log('Animation ended'), // This runs after both onComplete and onStop
  1686. })
  1687. // await for animation. This promise will reject only if an exception is thrown in onStop or onComplete. onStop rejects if throwOnStop is true
  1688. await anim.promise.catch((e)=>{
  1689. console.log(e, 'animation stopped before completion')
  1690. });
  1691. // or stop the animation
  1692. // anim.stop()
  1693. // Animate the color
  1694. await popmotion.animateAsync({ // Also await for the animation.
  1695. from: '#' + cube.material.color.getHexString(),
  1696. to: '#' + new Color().setHSL(Math.random(), 1, 0.5).getHexString(),
  1697. duration: 1000, // 1s
  1698. onUpdate: (v) => {
  1699. cube.material.color.set(v)
  1700. cube.material.setDirty()
  1701. },
  1702. })
  1703. ```
  1704. Note: The animation is started when the animate or animateAsync function is called.
  1705. ## CameraViewPlugin
  1706. [//]: # (todo: image)
  1707. [Example](https://threepipe.org/examples/#camera-view-plugin/) &mdash;
  1708. [Source Code](./src/plugins/animation/CameraViewPlugin.ts) &mdash;
  1709. [API Reference](https://threepipe.org/docs/classes/CameraViewPlugin.html)
  1710. CameraViewPlugin adds support to save and load camera views, which can then be animated to.
  1711. It uses PopmotionPlugin internally to animate any camera to a saved view or to loop through all the saved views.
  1712. It also provides a UI to manage the views.
  1713. ```typescript
  1714. import {CameraViewPlugin, ThreeViewer, CameraView, Vector3, Quaternion, EasingFunctions, timeout} from 'threepipe'
  1715. const viewer = new ThreeViewer({...})
  1716. const cameraViewPlugin = viewer.addPluginSync(new CameraViewPlugin())
  1717. const intialView = cameraViewPlugin.getView()
  1718. // or = viewer.scene.mainCamera.getView()
  1719. // create a new view
  1720. const view = new CameraView(
  1721. 'My View', // name
  1722. new Vector3(0, 0, 10), // position
  1723. new Vector3(0, 0, 0), // target
  1724. new Quaternion(0, 0, 0, 1), // quaternion rotation
  1725. 1 // zoom
  1726. )
  1727. // or clone a view
  1728. const view2 = intialView.clone()
  1729. view2.position.add(new Vector3(0, 5, 0)) // move up 5 units
  1730. // animate the main camera to a view
  1731. await cameraViewPlugin.animateToView(
  1732. view,
  1733. 2000, // in ms, = 2sec
  1734. EasingFunctions.easeInOut,
  1735. ).catch(()=>console.log('Animation stopped'))
  1736. // stop any/all animations
  1737. cameraViewPlugin.stopAllAnimations()
  1738. // add views to the plugin
  1739. cameraViewPlugin.addView(view)
  1740. cameraViewPlugin.addView(view2)
  1741. cameraViewPlugin.addView(intialView)
  1742. cameraViewPlugin.addCurrentView() // adds the current view of the main camera
  1743. // loop through all the views once
  1744. cameraViewPlugin.animDuration = 2000 // default duration
  1745. cameraViewPlugin.animEase = EasingFunctions.easeInOutSine // default easing
  1746. await cameraViewPlugin.animateAllViews()
  1747. // loop through all the views forever
  1748. cameraViewPlugin.viewLooping = true
  1749. await timeout(10000) // wait for some time
  1750. // stop looping
  1751. cameraViewPlugin.viewLooping = false
  1752. ```
  1753. ## RenderTargetPreviewPlugin
  1754. [//]: # (todo: image)
  1755. [Example](https://threepipe.org/examples/#render-target-preview/) &mdash;
  1756. [Source Code](./src/plugins/ui/RenderTargetPreviewPlugin.ts) &mdash;
  1757. [API Reference](https://threepipe.org/docs/classes/RenderTargetPreviewPlugin.html)
  1758. RenderTargetPreviewPlugin is a useful development and debugging plugin that renders any registered render-target to the screen in small collapsable panels.
  1759. ```typescript
  1760. import {ThreeViewer, RenderTargetPreviewPlugin, NormalBufferPlugin} from 'threepipe'
  1761. const viewer = new ThreeViewer({...})
  1762. const normalPlugin = viewer.addPluginSync(new NormalBufferPlugin(HalfFloatType))
  1763. const previewPlugin = viewer.addPluginSync(new RenderTargetPreviewPlugin())
  1764. // Show the normal buffer in a panel
  1765. previewPlugin.addTarget(()=>normalPlugin.target, 'normal', false, false)
  1766. ```
  1767. ## GeometryUVPreviewPlugin
  1768. [//]: # (todo: image)
  1769. [Example](https://threepipe.org/examples/#geometry-uv-preview/) &mdash;
  1770. [Source Code](./src/plugins/ui/GeometryUVPreviewPlugin.ts) &mdash;
  1771. [API Reference](https://threepipe.org/docs/classes/GeometryUVPreviewPlugin.html)
  1772. GeometryUVPreviewPlugin is a useful development and debugging plugin
  1773. that adds a panel to the viewer to show the UVs of a geometry.
  1774. ```typescript
  1775. import {ThreeViewer, GeometryUVPreviewPlugin, SphereGeometry} from 'threepipe'
  1776. const viewer = new ThreeViewer({...})
  1777. const previewPlugin = viewer.addPluginSync(new GeometryUVPreviewPlugin())
  1778. const geometry = new SphereGeometry(1, 32, 32)
  1779. // Show the normal buffer in a panel
  1780. previewPlugin.addGeometry(geometry, 'sphere')
  1781. ```
  1782. ## FrameFadePlugin
  1783. [//]: # (todo: image)
  1784. [Example](https://threepipe.org/examples/#frame-fade-plugin/) &mdash;
  1785. [Source Code](./src/plugins/pipeline/FrameFadePlugin.ts) &mdash;
  1786. [API Reference](https://threepipe.org/docs/classes/FrameFadePlugin.html)
  1787. FrameFadePlugin adds a post-render pass to the render manager and blends the last frame with the current frame over time. This is useful for creating smooth transitions between frames for example when changing the camera position, material, object properties, etc to avoid a sudden jump.
  1788. ```typescript
  1789. import {ThreeViewer, FrameFadePlugin} from 'threepipe'
  1790. const viewer = new ThreeViewer({...})
  1791. const fadePlugin = viewer.addPluginSync(new FrameFadePlugin())
  1792. // Make some changes in the scene (any visual change that needs to be faded)
  1793. // Start transition and wait for it to finish
  1794. await fadePlugin.startTransition(400) // duration in ms
  1795. ```
  1796. To stop a transition, call `fadePlugin.stopTransition()`. This will immediately set the current frame to the last frame and stop the transition. The transition is also automatically stopped when the camera is moved or some pointer event occurs on the canvas.
  1797. The plugin automatically tracks `setDirty()` function calls in objects, materials and the scene. It can be triggerred by calling `setDirty` on any material or object in the scene. Check the [example](https://threepipe.org/examples/#frame-fade-plugin/) for a demo. This can be disabled by options in the plugin.
  1798. ## VignettePlugin
  1799. [//]: # (todo: image)
  1800. [Example](https://threepipe.org/examples/#vignette-plugin/) &mdash;
  1801. [Source Code](./src/plugins/postprocessing/VignettePlugin.ts) &mdash;
  1802. [API Reference](https://threepipe.org/docs/classes/VignettePlugin.html)
  1803. VignettePlugin adds a post-processing material extension to the ScreenPass in render manager
  1804. that applies a vignette effect to the final render. The parameters `power` and `color` can be changed to customize the effect.
  1805. ```typescript
  1806. import {ThreeViewer, VignettePlugin} from 'threepipe'
  1807. const viewer = new ThreeViewer({...})
  1808. const vignettePlugin = viewer.addPluginSync(VignettePlugin)
  1809. // Change the vignette color
  1810. vignettePlugin.power = 1
  1811. vignettePlugin.color = new Color(0.5, 0, 0)
  1812. // or
  1813. // vignettePlugin.color.set('#ff0000'); vignettePlugin.setDirty() // Call setDirty to tell the plugin that color has changed
  1814. ```
  1815. ## ChromaticAberrationPlugin
  1816. [//]: # (todo: image)
  1817. [Example](https://threepipe.org/examples/#chromatic-aberration-plugin/) &mdash;
  1818. [Source Code](./src/plugins/postprocessing/ChromaticAberrationPlugin.ts) &mdash;
  1819. [API Reference](https://threepipe.org/docs/classes/ChromaticAberrationPlugin.html)
  1820. ChromaticAberrationPlugin adds a post-processing material extension to the ScreenPass in render manager
  1821. that applies a chromatic-aberration effect to the final render. The parameter `intensity` can be changed to customize the effect.
  1822. ```typescript
  1823. import {ThreeViewer, ChromaticAberrationPlugin} from 'threepipe'
  1824. const viewer = new ThreeViewer({...})
  1825. const chromaticAberrationPlugin = viewer.addPluginSync(ChromaticAberrationPlugin)
  1826. // Change the chromaticAberration color
  1827. chromaticAberrationPlugin.intensity = 0.5
  1828. ```
  1829. ## FilmicGrainPlugin
  1830. [//]: # (todo: image)
  1831. [Example](https://threepipe.org/examples/#filmic-grain-plugin/) &mdash;
  1832. [Source Code](./src/plugins/postprocessing/FilmicGrainPlugin.ts) &mdash;
  1833. [API Reference](https://threepipe.org/docs/classes/FilmicGrainPlugin.html)
  1834. FilmicGrainPlugin adds a post-processing material extension to the ScreenPass in render manager
  1835. that applies a filmic-grain effect to the final render. The parameters `power` and `color` can be changed to customize the effect.
  1836. ```typescript
  1837. import {ThreeViewer, FilmicGrainPlugin} from 'threepipe'
  1838. const viewer = new ThreeViewer({...})
  1839. const filmicGrainPlugin = viewer.addPluginSync(FilmicGrainPlugin)
  1840. // Change the filmicGrain color
  1841. filmicGrainPlugin.intensity = 10
  1842. filmicGrainPlugin.multiply = false
  1843. ```
  1844. ## NoiseBumpMaterialPlugin
  1845. [//]: # (todo: image)
  1846. [Example](https://threepipe.org/examples/#noise-bump-material-plugin/) &mdash;
  1847. [Source Code](./src/plugins/material/NoiseBumpMaterialPlugin.ts) &mdash;
  1848. [API Reference](https://threepipe.org/docs/classes/NoiseBumpMaterialPlugin.html)
  1849. NoiseBumpMaterialPlugin adds a material extension to PhysicalMaterial to add support for sparkle bump / noise bump by creating procedural bump map from noise to simulate sparkle flakes.
  1850. It uses voronoise function from blender along with several additions to generate the noise for the generation.
  1851. It also adds a UI to the material to edit the settings.
  1852. It uses `WEBGI_materials_noise_bump` glTF extension to save the settings in glTF/glb files.
  1853. ```typescript
  1854. import {ThreeViewer, NoiseBumpMaterialPlugin} from 'threepipe'
  1855. const viewer = new ThreeViewer({...})
  1856. const noiseBump = viewer.addPluginSync(NoiseBumpMaterialPlugin)
  1857. // Add noise bump to a material
  1858. NoiseBumpMaterialPlugin.AddNoiseBumpMaterial(material, {
  1859. flakeScale: 300,
  1860. })
  1861. // Change properties with code or use the UI
  1862. material.userData._noiseBumpMat!.bumpNoiseParams = [1, 1]
  1863. material.setDirty()
  1864. // Disable
  1865. material.userData._noiseBumpMat!.hasBump = false
  1866. material.setDirty()
  1867. ```
  1868. ## CustomBumpMapPlugin
  1869. [//]: # (todo: image)
  1870. [Example](https://threepipe.org/examples/#custom-bump-map-plugin/) &mdash;
  1871. [Source Code](./src/plugins/material/CustomBumpMapPlugin.ts) &mdash;
  1872. [API Reference](https://threepipe.org/docs/classes/CustomBumpMapPlugin.html)
  1873. CustomBumpMapPlugin adds a material extension to PhysicalMaterial to support custom bump maps.
  1874. A Custom bump map is similar to the built-in bump map, but allows using an extra bump map and scale to give a combined effect.
  1875. This plugin also has support for bicubic filtering of the custom bump map and is enabled by default.
  1876. It also adds a UI to the material to edit the settings.
  1877. It uses `WEBGI_materials_custom_bump_map` glTF extension to save the settings in glTF/glb files.
  1878. ```typescript
  1879. import {ThreeViewer, CustomBumpMapPlugin} from 'threepipe'
  1880. const viewer = new ThreeViewer({...})
  1881. const customBump = viewer.addPluginSync(CustomBumpMapPlugin)
  1882. // Add noise bump to a material
  1883. customBump.enableCustomBump(material, bumpMap, 0.2)
  1884. // Change properties with code or use the UI
  1885. material.userData._customBumpMat = texture
  1886. material.setDirty()
  1887. // Disable
  1888. material.userData._hasCustomBump = false
  1889. // or
  1890. material.userData._customBumpMat = null
  1891. material.setDirty()
  1892. ```
  1893. ## ClearcoatTintPlugin
  1894. [//]: # (todo: image)
  1895. [Example](https://threepipe.org/examples/#clearcoat-tint-plugin/) &mdash;
  1896. [Source Code](./src/plugins/material/ClearcoatTintPlugin.ts) &mdash;
  1897. [API Reference](https://threepipe.org/docs/classes/ClearcoatTintPlugin.html)
  1898. ClearcoatTintPlugin adds a material extension to PhysicalMaterial which adds tint and thickness to the built-in clearcoat properties.
  1899. It also adds a UI to the material to edit the settings.
  1900. It uses `WEBGI_materials_clearcoat_tint` glTF extension to save the settings in glTF/glb files.
  1901. ```typescript
  1902. import {ThreeViewer, ClearcoatTintPlugin} from 'threepipe'
  1903. const viewer = new ThreeViewer({...})
  1904. const clearcoatTint = viewer.addPluginSync(ClearcoatTintPlugin)
  1905. material.clearcoat = 1
  1906. // add initial properties
  1907. ClearcoatTintPlugin.AddClearcoatTint(material, {
  1908. tintColor: '#ff0000',
  1909. thickness: 1,
  1910. })
  1911. // Change properties with code or use the UI
  1912. material.userData._clearcoatTint!.tintColor = '#ff0000'
  1913. material.setDirty()
  1914. // Disable
  1915. material.userData._clearcoatTint.enableTint = false
  1916. material.setDirty()
  1917. ```
  1918. ## FragmentClippingExtensionPlugin
  1919. [//]: # (todo: image)
  1920. [Example](https://threepipe.org/examples/#fragment-clipping-extension-plugin/) &mdash;
  1921. [Source Code](./src/plugins/material/FragmentClippingExtensionPlugin.ts) &mdash;
  1922. [API Reference](https://threepipe.org/docs/classes/FragmentClippingExtensionPlugin.html)
  1923. FragmentClippingExtensionPlugin adds a material extension to PhysicalMaterial to add support for fragment clipping.
  1924. Fragment clipping allows to clip fragments of the material in screen space or world space based on a circle, rectangle, plane, sphere, etc.
  1925. It uses fixed SDFs with params defined by the user for clipping.
  1926. It also adds a UI to the material to edit the settings.
  1927. It uses `WEBGI_materials_fragment_clipping_extension` glTF extension to save the settings in glTF/glb files.
  1928. ```typescript
  1929. import {ThreeViewer, FragmentClippingExtensionPlugin} from 'threepipe'
  1930. const viewer = new ThreeViewer({...})
  1931. const fragmentClipping = viewer.addPluginSync(FragmentClippingExtensionPlugin)
  1932. // add initial properties
  1933. FragmentClippingExtensionPlugin.AddFragmentClipping(material, {
  1934. clipPosition: new Vector4(0.5, 0.5, 0, 0),
  1935. clipParams: new Vector4(0.1, 0.05, 0, 1),
  1936. })
  1937. // Change properties with code or use the UI
  1938. material.userData._fragmentClipping!.clipPosition.set(0, 0, 0, 0)
  1939. material.setDirty()
  1940. // Disable
  1941. material.userData._clearcoatTint.clipEnabled = false
  1942. material.setDirty()
  1943. ```
  1944. ## HDRiGroundPlugin
  1945. [//]: # (todo: image)
  1946. [Example](https://threepipe.org/examples/#hdri-ground-plugin/) &mdash;
  1947. [Source Code](./src/plugins/extras/HDRiGroundPlugin.ts) &mdash;
  1948. [API Reference](https://threepipe.org/docs/classes/HDRiGroundPlugin.html)
  1949. HDRiGroundPlugin patches the background shader in the renderer to add support for ground projected environment map/skybox. Works simply by setting the background same as the environemnt and enabling the plugin.
  1950. The world radius, tripod height, and origin position(center offset) can be set in the plugin.
  1951. The plugin is disabled by default when added. Set `.enabled` to enable it or pass `true` in the constructor.
  1952. If the background is not the same as the environment when enabled, the user will be prompted for this, unless `promptOnBackgroundMismatch` is set to `false` in the plugin.
  1953. ```typescript
  1954. import {ThreeViewer, HDRiGrounPlugin} from 'threepipe'
  1955. const viewer = new ThreeViewer({...})
  1956. const hdriGround = viewer.addPluginSync(new HDRiGrounPlugin())
  1957. // Load an hdr environment map
  1958. await viewer.setEnvironmentMap('https://threejs.org/examples/textures/equirectangular/venice_sunset_1k.hdr')
  1959. // set background to environment
  1960. viewer.scene.background = 'environment'
  1961. // or
  1962. // viewer.scene.background = viewer.scene.environemnt
  1963. // enable the plugin
  1964. hdriGround.enabled = true
  1965. ```
  1966. Check the [example](https://threepipe.org/examples/#hdri-ground-plugin/) for a demo.
  1967. ## VirtualCamerasPlugin
  1968. [//]: # (todo: image)
  1969. [Example](https://threepipe.org/examples/#virtual-cameras-plugin/) &mdash;
  1970. [Source Code](./src/plugins/rendering/VirtualCamerasPlugin.ts) &mdash;
  1971. [API Reference](https://threepipe.org/docs/classes/VirtualCamerasPlugin.html)
  1972. VirtualCamerasPlugin adds support for rendering to multiple virtual cameras in the viewer. These cameras are rendered in preRender callback just before the main camera is rendered. The virtual cameras can be added to the plugin and removed from it.
  1973. The feed to the virtual camera is rendered to a Render Target texture which can be accessed and re-rendered in the scene or used in other plugins.
  1974. ```typescript
  1975. import {ThreeViewer, VirtualCamerasPlugin} from 'threepipe'
  1976. const viewer = new ThreeViewer({...})
  1977. const virtualCameras = viewer.addPluginSync(new VirtualCamerasPlugin())
  1978. const camera = new PerspectiveCamera2('orbit', viewer.canvas, false, 45, 1)
  1979. camera.name = name
  1980. camera.position.set(0, 5, 0)
  1981. camera.target.set(0, 0.25, 0)
  1982. camera.userData.autoLookAtTarget = true // automatically look at the target (in setDirty)
  1983. camera.setDirty()
  1984. camera.addEventListener('update', ()=>{
  1985. viewer.setDirty() // if the camera is not added to the scene it wont update automatically when camera.setDirty is called(like from the UI)
  1986. })
  1987. const vCam = virtualCameras.addCamera(camera)
  1988. console.log(vCam.target) // target is a WebGLRenderTarget/IRenderTarget
  1989. ```
  1990. Check the [virtual camera](https://threepipe.org/examples/#virtual-camera/) example for using the texture in the scene.
  1991. ## EditorViewWidgetPlugin
  1992. [//]: # (todo: image)
  1993. [Example](https://threepipe.org/examples/#editor-view-widget-plugin/) &mdash;
  1994. [Source Code](./src/plugins/interaction/EditorViewWidgetPlugin.ts) &mdash;
  1995. [API Reference](https://threepipe.org/docs/classes/EditorViewWidgetPlugin.html)
  1996. EditorViewWidgetPlugin adds a ViewHelper in the parent of the viewer canvas to show the current camera view and allow the user to change the camera view to one of the primary world axes.
  1997. Simply add the plugin to the viewer to see the widget.
  1998. ```typescript
  1999. import {ThreeViewer, EditorViewWidgetPlugin} from 'threepipe'
  2000. const viewer = new ThreeViewer({...})
  2001. const plugin = viewer.addPluginSync(new EditorViewWidgetPlugin())
  2002. // to hide the widget
  2003. plugin.enabled = false
  2004. ```
  2005. ## Rhino3dmLoadPlugin
  2006. [Example](https://threepipe.org/examples/#rhino3dm-load/) &mdash;
  2007. [Source Code](./src/plugins/import/Rhino3dmLoadPlugin.ts) &mdash;
  2008. [API Reference](https://threepipe.org/docs/classes/Rhino3dmLoadPlugin.html)
  2009. Adds support for loading .3dm files generated by [Rhino 3D](https://www.rhino3d.com/). This plugin includes some changes with how 3dm files are loaded in three.js. The changes are around loading layer and primitive properties when set as reference in the 3dm files.
  2010. It also adds some helpful options to process the model after load.
  2011. ```typescript
  2012. import {Rhino3dmLoadPlugin} from 'threepipe'
  2013. const rhino3dmPlugin = viewer.addPluginSync(new Rhino3dmLoadPlugin())
  2014. rhino3dmPlugin.importMaterials = true // import materials source from 3dm file
  2015. rhino3dmPlugin.forceLayerMaterials = true // force material source to be layer in 3dm file.
  2016. rhino3dmPlugin.hideLineMesh = true // hide all lines and points in the model.
  2017. rhino3dmPlugin.replaceWithInstancedMesh = true // replace meshes with the same parent, geometry and material with a single instance mesh.
  2018. const mesh = await viewer.load('file.3dm')
  2019. ```
  2020. ## PLYLoadPlugin
  2021. [Example](https://threepipe.org/examples/#ply-load/) &mdash;
  2022. [Source Code](./src/plugins/import/PLYLoadPlugin.ts) &mdash;
  2023. [API Reference](https://threepipe.org/docs/classes/PLYLoadPlugin.html)
  2024. Adds support for loading .ply ([Polygon file format](https://en.wikipedia.org/wiki/PLY_(file_format))) files.
  2025. ```typescript
  2026. import {PLYLoadPlugin} from 'threepipe'
  2027. viewer.addPluginSync(new PLYLoadPlugin())
  2028. const mesh = await viewer.load('file.ply')
  2029. ```
  2030. ## USDZLoadPlugin
  2031. [Example](https://threepipe.org/examples/#usdz-load/) &mdash;
  2032. [Source Code](./src/plugins/import/USDZLoadPlugin.ts) &mdash;
  2033. [API Reference](https://threepipe.org/docs/classes/USDZLoadPlugin.html)
  2034. Adds support for loading .usdz and .usda ([Universal Scene Description](https://graphics.pixar.com/usd/docs/index.html)) files.
  2035. ```typescript
  2036. import {USDZLoadPlugin} from 'threepipe'
  2037. viewer.addPluginSync(new USDZLoadPlugin())
  2038. const mesh = await viewer.load('file.usdz')
  2039. const mesh2 = await viewer.load('file.usda')
  2040. ```
  2041. ## STLLoadPlugin
  2042. [Example](https://threepipe.org/examples/#stl-load/) &mdash;
  2043. [Source Code](./src/plugins/import/STLLoadPlugin.ts) &mdash;
  2044. [API Reference](https://threepipe.org/docs/classes/STLLoadPlugin.html)
  2045. Adds support for loading .stl ([Stereolithography](https://en.wikipedia.org/wiki/STL_(file_format))) files.
  2046. ```typescript
  2047. import {STLLoadPlugin} from 'threepipe'
  2048. viewer.addPluginSync(new STLLoadPlugin())
  2049. const mesh = await viewer.load('file.stl')
  2050. ```
  2051. ## KTX2LoadPlugin
  2052. [Example](https://threepipe.org/examples/#ktx2-load/) &mdash;
  2053. [Source Code](./src/plugins/import/KTX2LoadPlugin.ts) &mdash;
  2054. [API Reference](https://threepipe.org/docs/classes/KTX2LoadPlugin.html)
  2055. Adds support for loading .ktx2 ([Khronos Texture](https://www.khronos.org/opengles/sdk/tools/KTX/file_format_spec/) files.
  2056. KTX2LoadPlugin also adds support for exporting loaded .ktx2 files in glTF files with the [KHR_texture_basisu](https://www.khronos.org/registry/KHR/textures/2.0-extensions/KHR_texture_basisu/) extension.
  2057. ```typescript
  2058. import {KTX2LoadPlugin} from 'threepipe'
  2059. viewer.addPluginSync(new KTX2LoadPlugin())
  2060. const texture = await viewer.load('file.ktx2')
  2061. ```
  2062. ## KTXLoadPlugin
  2063. [Example](https://threepipe.org/examples/#ktx-load/) &mdash;
  2064. [Source Code](./src/plugins/import/KTXLoadPlugin.ts) &mdash;
  2065. [API Reference](https://threepipe.org/docs/classes/KTXLoadPlugin.html)
  2066. Adds support for loading .ktx ([Khronos Texture](https://www.khronos.org/opengles/sdk/tools/KTX/file_format_spec/) files.
  2067. Note: This plugin only adds support for loading .ktx file, and not exporting them in the bundled .glb. Use .ktx2 files instead of .ktx files for better compression and performance.
  2068. ```typescript
  2069. import {KTXLoadPlugin} from 'threepipe'
  2070. viewer.addPluginSync(new KTXLoadPlugin())
  2071. const texture = await viewer.load('file.ktx')
  2072. ```
  2073. # @threepipe Packages
  2074. Additional plugins can be found in the [plugins](plugins/) directory.
  2075. These add support for integrating with other libraries, adding new features, and other functionality with different licenses.
  2076. ## @threepipe/plugin-tweakpane
  2077. [Tweakpane](https://tweakpane.github.io/docs/) UI plugin for ThreePipe
  2078. [//]: # (todo: image)
  2079. [Example](https://threepipe.org/examples/#tweakpane-ui-plugin/) &mdash;
  2080. [Source Code](./plugins/tweakpane/src/TweakpaneUiPlugin.ts) &mdash;
  2081. [API Reference](https://threepipe.org/plugins/tweakpane/docs/classes/TweakpaneUiPlugin.html)
  2082. NPM: `npm install @threepipe/plugin-tweakpane`
  2083. CDN: https://threepipe.org/plugins/tweakpane/dist/index.mjs
  2084. TweakpaneUiPlugin adds support for using [uiconfig-tweakpane](https://github.com/repalash/uiconfig-tweakpane)
  2085. to create a configuration UI in applications using the [Tweakpane](https://tweakpane.github.io/docs/) library.
  2086. The plugin takes the [uiconfig](https://github.com/repalash/uiconfig.js)
  2087. that's defined in the viewer and all the objects to automatically render a UI in the browser.
  2088. ```typescript
  2089. import {IObject3D, ThreeViewer, TonemapPlugin} from 'threepipe'
  2090. import {TweakpaneUiPlugin} from '@threepipe/plugin-tweakpane'
  2091. const viewer = new ThreeViewer({...})
  2092. // Add the plugin
  2093. const plugin = viewer.addPluginSync(new TweakpaneUiPlugin(true)) // true to show expanded the UI by default
  2094. // Add the UI for the viewer
  2095. plugin.appendChild(viewer.uiConfig)
  2096. // Add UI for some plugins
  2097. plugin.setupPlugins(TonemapPlugin, DropzonePlugin)
  2098. ```
  2099. ## @threepipe/plugin-blueprintjs
  2100. [Blueprint.js](https://blueprintjs.com/) UI plugin for ThreePipe
  2101. [//]: # (todo: image)
  2102. [Example](https://threepipe.org/examples/#blueprintjs-ui-plugin/) &mdash;
  2103. [Source Code](./plugins/blueprintjs/src/BlueprintJsUiPlugin.ts) &mdash;
  2104. [API Reference](https://threepipe.org/plugins/blueprintjs/docs/classes/BlueprintJsUiPlugin.html)
  2105. NPM: `npm install @threepipe/plugin-blueprintjs`
  2106. CDN: https://threepipe.org/plugins/blueprintjs/dist/index.mjs
  2107. BlueprintJsUiPlugin adds support for using [uiconfig-blueprint](https://github.com/repalash/uiconfig-blueprint)
  2108. to create a configuration UI in applications using the [BlueprintJs](https://blueprintjs.com/) library.
  2109. The plugin takes the [uiconfig](https://github.com/repalash/uiconfig.js)
  2110. that's defined in the viewer and all the objects to automatically render a UI in the browser.
  2111. ```typescript
  2112. import {IObject3D, ThreeViewer, TonemapPlugin} from 'threepipe'
  2113. import {BlueprintJsUiPlugin} from '@threepipe/plugin-blueprintjs'
  2114. const viewer = new ThreeViewer({...})
  2115. // Add the plugin
  2116. const plugin = viewer.addPluginSync(new BlueprintJsUiPlugin(true)) // true to show expanded the UI by default
  2117. // Add the UI for the viewer
  2118. plugin.appendChild(viewer.uiConfig)
  2119. // Add UI for some plugins
  2120. plugin.setupPlugins(TonemapPlugin, DropzonePlugin)
  2121. ```
  2122. ## @threepipe/plugin-tweakpane-editor
  2123. Tweakpane Editor Plugin for ThreePipe
  2124. [//]: # (todo: image)
  2125. [Example](https://threepipe.org/examples/#tweakpane-editor/) &mdash;
  2126. [Source Code](./plugins/tweakpane-editor/src/TweakpaneEditorPlugin.ts) &mdash;
  2127. [API Reference](https://threepipe.org/plugins/tweakpane-editor/docs/classes/TweakpaneEditorPlugi &mdash;
  2128. NPM: `npm install @threepipe/plugin-tweakpane-editor`
  2129. CDN: https://threepipe.org/plugins/tweakpane-editor/dist/index.mjs
  2130. TweakpaneEditorPlugin uses TweakpaneUiPlugin to create an editor for editing viewer,
  2131. plugins, model and material configurations in the browser.
  2132. ```typescript
  2133. import {IObject3D, ThreeViewer, TonemapPlugin} from 'threepipe'
  2134. import {TweakpaneEditorPlugin} from '@threepipe/plugin-tweakpane-editor'
  2135. const viewer = new ThreeViewer({...})
  2136. viewer.addPluginSync(new TweakpaneUiPlugin(true))
  2137. const editor = viewer.addPluginSync(new TweakpaneEditorPlugin())
  2138. // Add some plugins to the viewer
  2139. await viewer.addPlugins([
  2140. new ViewerUiConfigPlugin(),
  2141. // new SceneUiConfigPlugin(), // this is already in ViewerUiPlugin
  2142. new DepthBufferPlugin(HalfFloatType, true, true),
  2143. new NormalBufferPlugin(HalfFloatType, false),
  2144. new RenderTargetPreviewPlugin(false),
  2145. ])
  2146. // Load the plugin UI in the editor and tweakpane ui with categories.
  2147. editor.loadPlugins({
  2148. ['Viewer']: [ViewerUiConfigPlugin, SceneUiConfigPlugin, DropzonePlugin, FullScreenPlugin],
  2149. ['GBuffer']: [DepthBufferPlugin, NormalBufferPlugin],
  2150. ['Post-processing']: [TonemapPlugin],
  2151. ['Debug']: [RenderTargetPreviewPlugin],
  2152. })
  2153. ```
  2154. ## @threepipe/plugins-extra-importers
  2155. Exports several plugins to add support for various file types.
  2156. [Example](https://threepipe.org/examples/#extra-importer-plugins/) &mdash;
  2157. [Source Code](./plugins/extra-importers/src/index.ts) &mdash;
  2158. [API Reference](https://threepipe.org/plugins/extra-importers/docs)
  2159. NPM: `npm install @threepipe/plugins-extra-importers`
  2160. CDN: https://threepipe.org/plugins/extra-importers/dist/index.mjs
  2161. This package exports several plugins to add support for several file types using the following plugins
  2162. - [TDSLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/TDSLoadPlugin.html) - Load 3DS Max (.3ds) files
  2163. - [ThreeMFLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/ThreeMFLoadPlugin.html) - Load 3MF (.3mf) files
  2164. - [ColladaLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/ColladaLoadPlugin.html) - Load Collada (.dae) files
  2165. - [AMFLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/AMFLoadPlugin.html) - Load AMF (.amf) files
  2166. - [BVHLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/BVHLoadPlugin.html) - Load BVH (.bvh) files
  2167. - [VOXLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/VOXLoadPlugin.html) - Load MagicaVoxel (.vox) files
  2168. - [GCodeLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/GCodeLoadPlugin.html) - Load GCode (.gcode) files
  2169. - [MDDLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/MDDLoadPlugin.html) - Load MDD (.mdd) files
  2170. - [PCDLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/PCDLoadPlugin.html) - Load Point cloud data (.pcd) files
  2171. - [TiltLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/TiltLoadPlugin.html) - Load Tilt Brush (.tilt) files
  2172. - [VRMLLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/VRMLLoadPlugin.html) - Load VRML (.wrl) files
  2173. - [MPDLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/MPDLoadPlugin.html) - Load LDraw (.mpd) files
  2174. - [VTKLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/VTKLoadPlugin.html) - Load VTK (.vtk) files
  2175. - [XYZLoadPlugin](https://threepipe.org/plugins/extra-importers/docs/classes/XYZLoadPlugin.html) - Load XYZ (.xyz) files
  2176. To add all the plugins at once use `extraImporters`. This adds support for loading all the above file types.
  2177. ```typescript
  2178. import {ThreeViewer} from 'threepipe'
  2179. import {extraImporters} from '@threepipe/plugins-extra-importers'
  2180. const viewer = new ThreeViewer({...})
  2181. viewer.addPluginsSync(extraImporters)
  2182. // Now load any file as is.
  2183. const model = await viewer.load<IObject3D>('file.3mf')
  2184. // To load the file as a data url, use the correct mimetype
  2185. const model1 = await viewer.load<IObject3D>('data:model/3mf;base64,...')
  2186. ```
  2187. Remove the `<IObject3D>` if using javascript and not typescript.
  2188. ## @threepipe/plugin-blend-importer
  2189. Exports [BlendImporterPlugin](https://threepipe.org/plugins/blend-importer/docs/classes/BlendLoadPlugin.html) which adds support for loading .blend files.
  2190. It uses [js.blend](https://github.com/acweathersby/js.blend) for parsing blend file structure.
  2191. Note: This is still a WIP.
  2192. Currently working: `Mesh`, `BufferGeometry` and basic `PointLight`.
  2193. To be added: `PhysicalMaterial`, `UnlitMaterial` (similar to blender-gltf-io plugin)
  2194. [Example](https://threepipe.org/examples/#blend-load/) &mdash;
  2195. [Source Code](./plugins/blend-importer/src/index.ts) &mdash;
  2196. [API Reference](https://threepipe.org/plugins/blend-importer/docs)
  2197. NPM: `npm install @threepipe/plugin-blend-importer`
  2198. ```typescript
  2199. import {ThreeViewer} from 'threepipe'
  2200. import {BlendLoadPlugin} from '@threepipe/plugin-blend-importer'
  2201. const viewer = new ThreeViewer({...})
  2202. viewer.addPluginSync(BlendLoadPlugin)
  2203. // Now load any .blend file.
  2204. const model = await viewer.load<IObject3D>('path/to/file.blend')
  2205. // To load the file as a data url, use the correct mimetype
  2206. const model1 = await viewer.load<IObject3D>('data:application/x-blender;base64,...')
  2207. ```
  2208. [//]: # ( TODO: The plugin should parse and references to other assets and find them relative to the .blend file or the current location.)
  2209. ## @threepipe/plugin-geometry-generator
  2210. Exports [GeometryGeneratorPlugin](https://threepipe.org/plugins/geometry-generator/docs/classes/BlendLoadPlugin.html) with several Geometry generators to create parametric and updatable geometries like plane, circle, sphere, box, torus, cylinder, cone etc.
  2211. [Example](https://threepipe.org/examples/#geometry-generator-plugin/) &mdash;
  2212. [Source Code](./plugins/geometry-generator/src/index.ts) &mdash;
  2213. [API Reference](https://threepipe.org/plugins/geometry-generator/docs)
  2214. NPM: `npm install @threepipe/plugin-geometry-generator`
  2215. The generated geometries/meshes include the parameters in the userData and can be re-generated by changing the parameters from the UI or the plugin API.
  2216. Includes the following generator which inherit from [AGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/AGeometryGenerator.html):
  2217. - **plane**: [PlaneGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/PlaneGeometryGenerator),
  2218. - **sphere**: [SphereGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/SphereGeometryGenerator),
  2219. - **box**: [BoxGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/BoxGeometryGenerator),
  2220. - **circle**: [CircleGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/CircleGeometryGenerator),
  2221. - **torus**: [TorusGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/TorusGeometryGenerator),
  2222. - **cylinder**: [CylinderGeometryGenerator](https://threepipe.org/plugins/geometry-generator/docs/classes/CylinderGeometryGenerator),
  2223. Sample Usage:
  2224. ```typescript
  2225. import {ThreeViewer} from 'threepipe'
  2226. import {GeometryGeneratorPlugin} from '@threepipe/plugin-geometry-generator'
  2227. const viewer = new ThreeViewer({...})
  2228. const generator = viewer.addPluginSync(GeometryGeneratorPlugin)
  2229. const sphere = generator.generateObject('sphere', {radius: 3})
  2230. viewer.scene.addObject(sphere)
  2231. // to update the geometry
  2232. generator.updateGeometry(sphere.geometry, {radius: 4, widthSegments: 100})
  2233. // to add a custom generator
  2234. generator.generators.custom = new CustomGenerator('custom') // Extend from AGeometryGenerator or implement GeometryGenerator
  2235. generator.uiConfig.uiRefresh?.()
  2236. ```