ArticlePDF Available

Application of the fractal Perlin noise algorithm for the generation of simulated breast tissue

Authors:

Abstract and Figures

Software breast phantoms are increasingly seeing use in preclinical validation of breast image acquisition systems and image analysis methods. Phantom realism has been proven sufficient for numerous specific validation tasks. A challenge is the generation of suitably realistic small-scale breast structures that could further improve the quality of phantom images. Power law noise follows the noise power characteristics of breast tissue, but may not sufficiently represent certain (e.g., non-Gaussian) properties seen in clinical breast images. The purpose of this work was to investigate the utility of fractal Perlin noise in generating more realistic breast tissue through investigation of its power spectrum and visual characteristics. Perlin noise is an algorithm that creates smoothly varying random structures of an arbitrary frequency. Through the use of a technique known as fractal noise or fractional Brownian motion (fBm), octaves of noise with different frequency are combined to generate coherent noise with a broad frequency range. fBm is controlled by two parameters - lacunarity and persistence - related to the frequency and amplitude of successive octaves, respectively. Average noise power spectra were calculated and beta parameters estimated in sample volumes of fractal Perlin noise with different combinations of lacunarity and persistence. Certain combinations of parameters resulted in noise volumes with beta values between 2 and 3, corresponding to reported measurements in real breast tissue. Different combinations of parameters resulted in different visual appearances. In conclusion, Perlin noise offers a flexible tool for generating breast tissue with realistic properties.
Content may be subject to copyright.
Application of the fractal Perlin noise algorithm for the generation of
simulated breast tissue
Magnus Dustler*1, Predrag Bakic2, Hannie Petersson1, Pontus Timberg1, Anders Tingberg1 and
Sophia Zackrisson3
1Medical Radiation Physics, Department of Translational Medicine, Lund University, SE 205 02
Malmö, Sweden; 2Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104,
USA; 3Diagnostic Radiology, Department of Translational Medicine, Lund University, SE 205 02
Malmö, Sweden
ABSTRACT
Software breast phantoms are increasingly seeing use in preclinical validation of breast image acquisition systems and
image analysis methods. Phantom realism has been proven sufficient for numerous specific validation tasks. A
challenge is the generation of suitably realistic small-scale breast structures that could further improve the quality of
phantom images. Power law noise follows the noise power characteristics of breast tissue, but may not sufficiently
represent certain (e.g., non-Gaussian) properties seen in clinical breast images. The purpose of this work was to
investigate the utility of fractal Perlin noise in generating more realistic breast tissue through investigation of its power
spectrum and visual characteristics. Perlin noise is an algorithm that creates smoothly varying random structures of an
arbitrary frequency. Through the use of a technique known as fractal noise or fractional Brownian motion (fBm), octaves
of noise with different frequency are combined to generate coherent noise with a broad frequency range. fBm is
controlled by two parameters – lacunarity and persistence – related to the frequency and amplitude of successive octaves,
respectively. Average noise power spectra were calculated and beta parameters estimated in sample volumes of fractal
Perlin noise with different combinations of lacunarity and persistence. Certain combinations of parameters resulted in
noise volumes with beta values between 2 and 3, corresponding to reported measurements in real breast tissue. Different
combinations of parameters resulted in different visual appearances. In conclusion, Perlin noise offers a flexible tool for
generating breast tissue with realistic properties.
Keywords: Mammography, Tomosynthesis, Anatomical noise, Software breast phantoms, Perlin noise
1. INTRODUCTION
Realistic-looking software breast phantoms have many applications in breast imaging research, especially for
characterization of the properties of new or emerging technologies. Using a software phantom – with or without a
simulated lesion – provides knowledge of the ground truth in observer studies, gives the researchers control over
breast anatomy and allows the generation of an arbitrary amount of images without concerns for radiation doses.
Many groups thus have worked on generating anthropomorphic phantoms that are suitably realistic for specific tasks
[1-15]. The challenge is to implement a random generation of realistic patterns of breast tissue using statistical
methods.
1.1 Power-law noise
Breast tissue, when projected onto a 2D-plane, have a Fourier domain frequency spectrum which follows a power
law distribution [16]. Based on these results, 2D-power law noise with β parameter values somewhere between 2
and 3 have been used to simulate the anatomical noise seen in clinical breast images [2, 16-18].
Power law noise alone, however, cannot capture the continuous anatomical structures which make up the breast and,
also, may not sufficiently represent certain (e.g., non-Gaussian) properties seen in clinical breast images [16, 17, 19,
20]. Recent papers by Abbey et al. have used a novel measure known as Laplacian fractional entropy (LFE), which
*Corresponding author. magnus.dustler@med.lu.se
Medical Imaging 2015: Physics of Medical Imaging, edited by Christoph Hoeschen, Despina Kontos,
Proc. of SPIE Vol. 9412, 94123E · © 2015 SPIE · CCC code: 1605-7422/15/$18 · doi: 10.1117/12.2081856
Proc. of SPIE Vol. 9412 94123E-1
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
quantifies the difference in entropy between the image histogram and a best-fit Gaussian distribution, normalized by
the entropy of a best-fit Laplacian distribution [19, 20]. They showed significant differences in LFE between
different simulated breast phantoms [20].
1.2 Appearance of dense tissue
Breast tissue is far from homogenous and the dense tissue that needs to be realistically simulated to obtain a good
software breast phantom actually consists of several types of distinct tissues with distinct appearances and patterns of
growth. According to the well-known Tabar classifications the four types of tissue within the breast are 1: nodular, 2:
linear, 3: homogenous and 4: radiolucent [21, 22]. As breasts consist of a mixture of these types of tissue, it is important
that any simulated noise share characteristics of all four.
1.3 Aim
The aim of this paper was to investigate the utility of fractal Perlin noise – a noise-generating method which creates
continuous, smoothly varying, random shapes – to simulate breast tissue by investigating its power spectrum and visual
appearance.
2. METHODS AND MATERIALS
2.1 Perlin noise
The fields of medical imaging and computer graphics share a need to realistically simulate natural structures and
textures. One of the most well-known methods to generate such structures in computer graphics is the Noise-algorithm
[23-25], which was the subject of a special Academy Award in 1997. The algorithm is commonly known as Perlin noise
after its creator and is employed to generate e.g. landscapes and clouds. Unlike a Gaussian noise distribution, Perlin
noise consists of coherent structures that are connected through smoothly varying gradients [26]. These basic shapes
form the basis of various more complex textures.
Perlin noise is a wavelet-based method where an n-dimensional set of points is evaluated on an n-dimensional evenly-
spaced grid, where every grid-point has a random gradient associated with it. Each point is set to a weighted average
between the scalar products between the gradients of the 2n closest grid-points and the vectors between it and those grid-
points. This creates structures of a scale (or, in other words, frequency) that is band limited by the spacing of the grid-
points and the spacing of the evaluated points. Figure 1 shows Perlin noise of various scales.
Figure 1. Examples of Perlin noise with different scale, i.e. number of grid points along each dimension. All images are
projections of 128x128x128 voxel 3D volumes. From left to right: scale = 2, 4, 8, 16, 32, 64, 128.
2.2 Fractal noise
As noted earlier, the spectral density of breast tissue obeys the power law distribution with β parameter values between 2
and 3 [16, 17, 27, 28]. As such, it includes tissue structures of many sizes with diminishing amplitudes, spanning a wide
range of spatial frequencies. Noise generated by the Perlin Noise-algorithm is itself limited to a narrow range of
frequencies.
Fractal noise is a process through which noise is generated at different scales (or frequencies) and added together to
create noise with a broader frequency range [29-32]. Successively smaller scales (higher frequencies) of noise are known
as octaves. Fractal noise is used both in signal processing and in 2D- and 3D-imaging applications. Due to its similarities
with Brownian motion, it is sometimes called fractional Brownian motion (fBm) [31, 32, 35]. A substantially different
implementation of fractional Brownian motion has also been used to simulate breast tissue using a random-walk
Proc. of SPIE Vol. 9412 94123E-2
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
.
approach [2]. Many different noise algorithms can be used to create the basis for fractal noise, including so-called
cellular or Worley noise, another widely used noise-generating algorithm [26].
Fractal Perlin noise can simulate many different structures and processes and has been used to render landscapes, water
and similar systems [35-39]. The fractal noise distribution f of starting frequency u can be expressed as
()=( ∙)

where g(u) is the noise function (Perlin noise, in this case), s is the persistence, w is the lacunarity and n is the number of
octaves included. Persistence controls the amplitude of the noise, with the amplitude at each successive octave being
equal to the amplitude at the previous octave multiplied by the persistence. Lacunarity, a value related to the fractal
dimension, defines the frequency gap between successive octaves, with the frequency of each octave equaling the
frequency of the previous one multiplied by the lacunarity. Varying these parameters creates structures with different
appearance and power spectrums. Examples of Perlin noise with fractional Brownian motion for various combinations of
persistence and lacunarity are shown in Figures 2.
Figure 2. Examples of fBm Perlin noise volumes with different combinations of lacunarity and persistence, projected onto
the 2D-plane. Lacunarity ranges from 2-4 with increments of 1 and persistence from 1-2 with increments of 0.5. On the left,
noise values are continuous and range from -1 to 1. On the right, noise values are binary, i.e. either set to 1 (dense tissue) or
0 (fatty tissue).
There are also many other ways of adding together octaves of noise to create interesting textures, such as modifying the
input noise function g(u) with some other function h(u), sometimes called a turbulence function, i.e.
()=ℎ( ∙)

Various turbulence functions can be used to change the appearance of the simulated noise. One example is Perlin’s
original implementation of marble-like textures using a sinusoidal function [23].
Proc. of SPIE Vol. 9412 94123E-3
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
2.3 Noise
ge
Fractal 3D P
on Perlin’s
created and
arameters c
elow the nu
the fraction
can interpret
within the v
had a standa
Figure 3
.
N
o turb
u
turbulen
c
2.4 Quantit
a
oise power
window and
volumes wer
used.
2.5 Qualita
t
Five additio
n
divergent ap
realism, in th
rating was p
normally us
conditions –
shown in Fig
In addition,
of adipose ti
s
dense or fatt
For this anal
for the dense
radiologists
ased on sin
e
neration
e
rlin noise w
a
d
etailed descr
i
the resulting
a
n be seen in
m
ber of voxe
l
o
f dense tissu
e
e
d as voxels
b
o
lume. Both
a
r
dized size of
.
Various Per
l
u
lence, (b).
N
c
e, (d). ()
=
a
tive anal
y
si
s
spectrums o
f
t
he β parame
t
e
created for
t
ive anal
y
sis
n
al noise volu
m
p
earances wh
i
e form of the
i
e
rformed on a
e
d for the re
v
b
ut using a s
t
u
re 3.
P
erlin noise u
s
s
sue compart
m
y
tissue, whil
e
y
sis, the com
p
compartmen
t
a
longside the
o
g
le AIP proje
c
a
s generated i
n
i
ption of the
cubic volu
m
Figure 2. T
h
l
s. Values in
e
e
in each vox
e
b
eing either
e
a
pproaches c
a
100x100x10
0
l
in-noise volu
o turbulence,
=
, (e). (
s
f
the 2D-
p
roj
e
t
er was found
each combin
a
m
es were ge
n
i
ch were all v
i
r plausibility
scale from 1
v
iew of scre
e
t
andard lapto
p
s
ed to modify
m
ents simula
t
e
the borders
b
p
artments we
r
t
s and low d
e
o
riginal phan
t
c
tions.
n
Matlab (M
a
algorithm [4
0
m
es were an
a
h
e number of
e
ach voxel ra
n
e
l. Binary vol
u
e
ntirely dens
e
a
n be seen as
0
voxels, with
mes used for
each octave
d
)=||
e
ction of the
by log/log li
n
a
tion of lacun
n
erated using
v
isually simil
a
as simulated
s
to 5, with 5
d
e
ning and cl
i
p
screen rath
e
the UPenn b
r
t
ed within a
3
b
etween com
p
r
e instead fill
e
e
nsity for the
f
t
om (Figure 4
a
thworks, Nat
0
]. Simulate
d
a
lyzed. Exam
p
octaves was
s
n
ged from -1
t
u
mes were al
s
e
or entirely
f
realistic way
s
an assumed
v
qualitative as
d
ilated with
a
3D-volume
w
n
ear regressio
n
arity and per
s
v
arious turbu
l
a
r to breast tis
s
ubstitute for
d
enoting the
h
i
nical image
s
e
r that a clini
c
r
east phanto
m
3
D-breast out
l
p
artments rep
r
e
d with
b
inar
y
f
atty compart
), who were
a
ick, MA, US
A
d
tissue with
d
p
les of nois
e
s
et so that th
e
t
o 1 with a ze
r
s
o created wit
h
f
atty with a 1
s
of depictin
g
v
oxel size of 1
sessment of i
m
a
n ellipsoidal
w
ere estimate
d
n
. For binary
s
istence, and
t
l
ence functio
n
s
ue. Four rad
i
the appearan
c
h
ighest plausi
b
s
, with dim
m
c
al workstati
o
m
[10]. The U
P
l
ine model.
E
r
esent fibrous
y
Perlin nois
e
m
ents. This
m
a
sked which
p
A
) using cod
e
d
ifferent lac
u
e
volumes w
i
e
number of
g
r
o mean, and
h
zero used a
s
:1 ratio bet
w
g
actual breas
t
00 µm.
m
age realis
m
.
structuring e
l
d
using a rot
a
and non-
b
ina
r
t
he average o
f
n
s in an attem
p
i
ologists wer
e
c
e of breast ti
s
b
ility. The vi
e
m
ed lights –
i
o
n. The five s
i
P
enn phanto
m
E
ach compart
m
tissue such
a
e
(similar to
F
m
odified pha
n
p
hantom they
e
developed i
n
u
narity and p
e
i
th the simul
g
rid points w
a
can be seen a
s
s
the threshol
d
w
een dense a
n
t
compositio
n
.
From left to
l
ement (c). B
i
a
tionally sym
m
r
y volumes r
e
f
the linear r
e
p
t to
p
roduce
e
asked to rat
e
s
sue in clinic
a
e
wings took p
l
i
dentical to
n
i
mulated tiss
u
m
consists of
a
m
ent is desig
n
a
s milk ducts
a
F
igure 3c) wit
h
n
tom was sho
w
would rate a
s
n
-house, base
d
e
rsistence wa
s
a
ted range o
a
s always ke
p
s
a measure o
d
value, whic
h
d fat
t
y voxel
s
n
. All volume
s
right: (a).
i
nary, no-
m
etrical Han
n
e
spectively, 1
0
e
gressions wa
s
volumes wit
h
e
their level o
a
l images. Th
e
l
ace in a roo
m
n
ormal revie
w
u
e samples ar
e
a
large numbe
r
n
ated as eithe
r
a
nd ligament
s
h
high densit
y
w
n to the fou
r
most realisti
c
d
s
f
p
t
f
h
s
s
n
0
s
h
f
e
m
w
e
r
r
s
.
y
r
c
Proc. of SPIE Vol. 9412 94123E-4
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
Figure 4. UPenn breast phantom modified with Perlin noise. Bottom projection image is the unmodified
phantom, with compartments designated as either dense or fatty tissue. The top image is the same phantom
modified with binary Perlin noise, with dense compartments being assigned a denser distribution of Perlin noise
than fatty ones.
3. RESULTS
3.1 Quantitative analysis
Estimates of β from linear regressions are shown in Tables 1 and 2. Binary volumes had a substantially lower β value,
indicating a lesser dampening of high frequencies. As expected increasing lacunarity and persistence both decrease the β
value. Using high lacunarity however means that the number of octaves will be low, making the spectrum discontinuous.
High persistence on the other hand emphasizes high-frequency noise, deemphasizing the continuous lower frequency
structures. Despite this, both assuming binary dense/non-dense tissue, and non-binary dense tissue fraction, values of β
between 2 and 3 were found for a range of persistence/lacunarity combinations.
Proc. of SPIE Vol. 9412 94123E-5
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
Table 1. Measured β for projected 3D-volumes
Persistence
1/4 ½ ¾ 1
Lacunairty
2 6.85±0.06 4.80±0.08 3.64±0.05 2.93±0.06
3 5.27±0.10 3.79±0.07 3.03±0.08 2.51±0.09
4 4.34±0.09 3.29±0.04 2.76±0.08 2.40±0.07
Table 2. Measured β for projected binary 3D-volumes
Persistence
1/4 ½ ¾ 1
Lacunairty
2 2.73±0.83 3.21±0.08 2.70±0.06 2.20±0.08
3 3.27±0.17 2.86±0.11 2.33±0.08 1.99±0.04
4 3.23±0.18 2.66±0.08 2.17±0.08 1.89±0.07
3.2 Qualitative analysis
Radiologists’ rankings of the plausibility of the five simulated tissue are presented in Table 3.
Table 3. Radiologists’ rankings of simulated tissue
Simulation 1 Simulation 2 Simulation 3 Simulation 4 Simulation 5
Radiologist 1 2 1 2 1 1
Radiologist 2 3 1 1 2 3
Radiologist 3 3 4 1 2 4
Radiologist 4 4 3 1 4 5
Mean ranking 3.0±0.8 2.3±1.5 1.3±0.5 2.0±1.3 3.3±1.7
For the phantom study, the four participating radiologists consistently indicated that the UPenn phantom with added
Perlin noise was more realistic than the unmodified phantom.
Proc. of SPIE Vol. 9412 94123E-6
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
4. DISCUSSION
Perlin noise has been used to simulate many different natural textures and it shows promise in also being able to
accurately simulating breast tissue with some tweaking of parameters. Measured β values indicate that fractal Perlin
noise can be used to provide tissue volumes with power spectrums that match realistic values, both for continuous and
binary volumes. Whether the appearance of the noise is realistic is another question.
Different turbulence functions provide substantially different structures. Nodular density looks similar to unmodified
fractal Perlin noise. Linear density could be represented by ridged noise, i.e. the absolute value of the Noise-function.
Homogenous densities can perhaps be simulated by aggressively thresholded noise volumes. Directionality of structures
could also be added by e.g. dilating selected noise octaves – as shown in one of the sample simulations in Figure 3 – with
ellipsoidal structuring elements. In the subjective opinions of the four radiologists who took part in the study, several of
these approaches provided relatively plausible facsimiles of breast tissue. Although the sample sizes were too small and
the task too broadly defined for any statistical analysis, the radiologists agreed that both unmodified fractal Perlin noise
and ridged fractal Perlin noise (i.e. absolute value) were plausible representations of tissue, while binary noise was less
plausible. Nevertheless, the modified UPenn phantom (containing binary fractal Perlin noise) was consistently ranked as
plausible; indicating that results from simulations viewed in isolation might not be representative of results from viewing
the entire phantom.
Directionality of structures could also be added by e.g. dilating selected noise octaves – as shown in one of the sample
simulations in Figure 3 – with ellipsoidal structuring elements or by using anisotropic grid spacing and matching the
direction to e.g. the principal direction of the compartments and sub-compartments of the UPenn breast phantom.
Further investigation of the non-Gaussian properties of the simulated tissue is required, such as the Laplacian fractional
entropy mentioned before. Also in order to match the density of real breasts, volumetric density assessment software
such as e.g. Volpara (Matakina Technology Ltd., Wellington, New Zealand) could be used to get baseline measurements
of variously dense and fatty breasts.
In conclusion, fractional Perlin noise offers a promising and flexible way of simulating plausible breast structures.
However, much work remains to be done in order to better align its appearance to real breast tissue.
ACKNOWLEDGMENTS
The authors would like to acknowledge the contribution of Dr. A.D.A Maidment of the University of Pennsylvania. The
research at Lund University was supported by the Swedish Breast Cancer Foundation – Bröstcancerfonden. The digital
breast phantom research at the University of Pennsylvania was supported by the NCI/NIH under award R01CA154444
and the Susan G. Komen Foundation Grant IIR13262248.
REFERENCES
[1] P. R. Bakic , M. Albert, D. Brzakovic et al., “Mammogram synthesis using a 3D simulation. II. Evaluation of
synthetic mammogram texture, “ Med. Phys. 29, 2140–2151 (2002)
[2] K. Bliznakova, Z. Bliznakov, V. Bravou et al. "A three-dimensional breast software phantom for
mammography simulation," Phys. Med. Biol. 48(22), 3699 (2003)
[3] N.V. Ruiter, C Zhang, P.R. Bakic, et al., “Simulation of tomosynthesis images based on an anthropomorphic
software breast tissue phantom,” Progress in Biomedical Optics and Imaging - Proceedings of SPIE, 6918
(2008)
[4] C.M. Li, W.P. Segars, G.D. Tourassi, et al., “Methodology for generating a 3D computerized breast phantom
from empirical data,” Med. Phys. 36 3122–3131 (2009)
[5] P.R. Bakic, P. Ringer, J. Kuo, et al., “Analysis of geometric accuracy in digital breast tomosynthesis
reconstruction”, Digital Mammography 6136, 62–69 (2010)
[6] P.R. Bakic, S. Ng, P. Ringer, et al. “Validation and optimization of digital breast tomosynthesis reconstruction
using an anthropomorphic software breast phantom,” Proc. SPIE 7622 (2010)
Proc. of SPIE Vol. 9412 94123E-7
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
[7] I. Reiser and R. Nishikawa, “Task-based assessment of breast tomosynthesis: effect of acquisition parameters
and quantum noise,” Med. Phys. 37, 1591–600 (2010)
[8] G. J. Gang, D. J. Tward, J. Lee et al., “Anatomical background and generalized detectability in tomosynthesis
and cone-beam CT,” Med. Phys. 37(5), 1948-65 (2010)
[9] K. Bliznakova, S. Suryanarayanan, A. Karellas, et al., “Evaluation of an improved algorithm for producing
realistic 3D breast software phantoms: Application for mammography,” Med. Phys. 37 (11), 5604-5617 (2010)
[10] P.R. Bakic, C. Zhang and A.D.A. Maidment, “Development and characterization of an anthropomorphic breast
software phantom based upon region-growing algorithm,” Med. Phys. 38, 3165–76 (2011)
[11] B. Chen, J. Shorey, R.S. Saunders, et al., “An anthropomorphic breast model for breast imaging simulation and
optimization” Acad. Radiol. 18, 536–546 (2011)
[12] D.D. Pokrajac, A.D.A Maidment and P.R. Bakic “Optimized generation of high resolution breast
anthropomorphic software phantoms” Med. Phys. 39, 2290–2302 (2012)
[13] B.A. Lau, I. Reiser, R.M. Nishikawa et al., “A statistically defined anthropomorphic software breast phantom ,“
Med. Phys. 39, 3375–3385 (2012)
[14] J.M. O’Connor, M Das, C.S. Dider, et al., “Generation of voxelized breast phantoms from surgical mastectomy
specimens,” Med. Phys. 40, 041915 (2013)
[15] L.C. Ikejimba, N Kiarashi, SV Ghate, et al., “Task-based strategy for optimized contrast enhanced breast
imaging: analysis of six imaging techniques for mammography and tomosynthesis,” Med. Phys. 41 (6), 061908,
(2014)
[16] A. E. Burgess, F. L. Jacobson, and P. F. Judy, “Human observer detection experiments with mammograms and
power-law noise,” Medical physics, 28(4), 419-37 (2001).
[17] F. O. Bochud, J. F. Valley, F. R. Verdun et al., “Estimation of the noisy component of anatomical
backgrounds,” Medical physics, 26(7), 1365-70 (1999).
[18] K. Bliznakova, R Speller, J Horrocks et al. "Experimental validation of a radiographic simulation code using
breast phantom for X-ray imaging," Comp. Biol. Med. 40(2), 208-214 (2010)
[19] C. K. Abbey, A. Nosrateih, J. Sohl-Dickstein et al., “Non-Gaussian statistical properties of breast images,” Med
Phys, 39(11), 7121-7130 (2012).
[20] C. K. Abbey, P. R. Bakic, D. D. Pokrajac et al., "Non-Gaussian statistical properties of virtual breast
phantoms." SPIE Medical Imaging, 90370G-90370G-8 (2014)
[21] I.T. Gram, E. Funkhouser, L. Tabar, “The Tabar classification of mammographic parenchymal patterns”. Eur J
Radiol, 24, 131-136 (1997).
[22] L. Tabár, T. Tot and P.B. Dean, [Breast Cancer: The Art And Science Of Early Detection With Mamography:
Perception, Interpretation, Histopatholigic Correlation.] Georg Thieme Verlag, Stuttgart (2004)
[23] K. Perlin, “An image synthesizer,” ACM Siggraph Computer Graphics, 19(3), 287-296 (1985).
[24] K. Perlin, “Improving noise,” Acm Transactions on Graphics, 21(3), 681-682 (2002).
[25] S. Worley, "A cellular texture basis function." Proceedings of the 23rd annual conference on Computer graphics
and interactive techniques, 291-294 (1996)
[26] S. Green, “Implementing improved perlin noise,” GPU Gems, 2, 409-416 (2005).
[27] L. Chen, C. K. Abbey, and J. M. Boone, “Association between power law coefficients of the anatomical noise
power spectrum and lesion detectability in breast imaging modalities,” Physics in medicine and biology, 58(6),
1663 (2013).
[28] E. Engstrom, I. Reiser, and R. Nishikawa, “Comparison of power spectra for tomosynthesis projections and
reconstructed images,” Med. Phys, 36(5), 1753-1758 (2009).
[29] J. C. Hart, "Perlin noise pixel shaders." Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on
Graphics hardware, 87-94 (2001)
[30] K. Perlin, and E. M. Hoffert, "Hypertexture." ACM SIGGRAPH Computer Graphics, 23(3), 253-262 (1989)
[31] F. K. Musgrave, C. E. Kolb, and R. S. Mace, "The synthesis and rendering of eroded fractal terrains." ACM
SIGGRAPH Computer Graphics, 23(3), 41-50.
[32] P. Flandrin, “Wavelet analysis and synthesis of fractional Brownian motion,” Information Theory, IEEE
Transactions on, 38(2), 910-917 (1992).
[33] B. B. Mandelbrot, [The fractal geometry of nature] W. H. Freeman and Co., New York (1983).
[34] B. B. Mandelbrot, and J. W. Van Ness, “Fractional Brownian motions, fractional noises and applications,”
SIAM review, 10(4), 422-437 (1968).
Proc. of SPIE Vol. 9412 94123E-8
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
[35] R. Bridson, J. Houriham, and M. Nordenstam, "Curl-noise for procedural fluid flow." ACM Transactions on
Graphics (TOG), 26(3), 46 (2007)
[36] I. Parberry, “Designer worlds: Procedural generation of infinite terrain from real-world elevation data,” Journal
of Computer Graphics Techniques Vol, 3(1), (2014).
[37] R. M. Smelik, K. J. De Kraker, T. Tutenel et al., "A survey of procedural methods for terrain modelling."
Proceedings of the CASA Workshop on 3D Advanced Media In Gaming And Simulation (3AMIGAS), 25-34
(2009)
[38] R. L. Cook, and T. DeRose, "Wavelet noise." ACM Transactions on Graphics (TOG), 24(3), 803-811 (2005).
[39] X. Yang, X. Pi, L. Zeng et al., "GPU-based real-time simulation and rendering of unbounded ocean surface."
Computer Aided Design and Computer Graphics, 2005. Ninth International Conference on, 6 pp (2005)
[40] K. Perlin, “Implementing improved perlin noise,” GPU Gems, 73-85 (2004).
Proc. of SPIE Vol. 9412 94123E-9
Downloaded From: http://spiedigitallibrary.org/ on 09/06/2016 Terms of Use: http://spiedigitallibrary.org/ss/termsofuse.aspx
... Here Perlin Noise was defined, only considering a maximum oscillation value, but several variations were developed according to the surface of interest (e.g. Dustler et al., 2015;Michot-Roberto et al., 2021). A further development here may entail use of different Perlin Noise methods, as well as a detailed sensitivity analysis of the output of the hydraulic model. ...
... Simplex noise is a gradient noise function that generates visually isotropic and continuous textures, and is commonly used in computer-generated graphics to procedurally create natural looking images. Its properties make it suitable for creating synthetic textures with realistic features in biomedical imaging (1,3,9,10) , and we use it here to generate an organic-like texture for the heart walls. ...
Article
Full-text available
In vivo fluorescence microscopy is a powerful tool to image the beating heart in its early development stages. A high acquisition frame rate is necessary to study its fast contractions, but the limited fluorescence intensity requires sensitive cameras that are often too slow. Moreover, the problem is even more complex when imaging distinct tissues in the same sample using different fluorophores. We present Paired Alternating AcQuisitions (PAAQ), a method to image cyclic processes in multiple channels, which requires only a single (possibly slow) camera. We generate variable temporal illumination patterns in each frame, alternating between channel-specific illuminations (fluorescence) in odd frames and a motion-encoding brightfield pattern as a common reference in even frames. Starting from the image pairs, we find the position of each reference frame in the cardiac cycle through a combination of image-based sorting and regularized curve fitting. Thanks to these estimated reference positions, we assemble multichannel videos whose frame rate is virtually increased. We characterize our method on synthetic and experimental images collected in zebrafish embryos, showing quantitative and visual improvements in the reconstructed videos over existing non-gated sorting-based alternatives. Using a 15 Hz camera, we showcase a reconstructed video containing 2 fluorescence channels at 100 fps. Impact Statement Our method enables imaging fast repeating processes like the heartbeat and reconstructing multichannel videos with a high temporal resolution without the need for a high-speed camera. It uses a custom hardware controller to modulate and synchronize multiple illumination and imaging devices. We share the code (for simulation and reconstrution) and hardware schematics to implement PAAQ, which allows replication and implementation in a wide array of existing lab microscopes.
... In the case of small datasets or lack of data, the use of phantom data can be granted. Our intention is to provide enough data relative to the implementation of a deep-learning scheme [18], [19]. ...
Chapter
In this paper, we propose a strategy to train a CNN to detect document manipulations in JPEG documents under data scarcity scenario. As it comes to scanned PDF documents, it is common that the document consists of a JPEG image encapsulated into a PDF. Indeed, if the document before tampering was a JPEG image, its manipulation will lead to double compression artefacts within the resulting tampered JPEG image. In contrast to related methods that are based on handcrafted histograms of DCT coefficients, we propose a double compression detection method using a one-hot encoding of the DCT coefficients of JPEG images. We can use accordingly a CNN model to compute co-occurrence matrices and avoid handcrafted features such as histograms. Using simulated frauds on Perlin noise, we train our network and then test it on textual images against a state-of-the-art CNN algorithm trained on natural images. Our approach has shown an encouraging generalization on both the database used in the paper and on a stream of synthetic frauds on real documents used in the company Yooz.
... However, while AIs have increased in sophistication, they have also become more difficult to use. Considering this, the creation of a new research field of Explainable AI for Designers (XAID) has been proposed [21]. In this context, [22] Gorm Lai and colleagues present three fundamental pillars that tools must be based on regarding the Human-AI interaction: ...
Article
Full-text available
This article presents the Biome Generation Tool (BGT), a mixed-initiative procedural content generator plugin for the Unity3D game engine that uses an Evolutionary Algorithm (EA) for the creation of biomes in videogames. A double-blind evaluation was performed with 28 videogame developers split into two groups. The experimental group received a standard BGT, while the control group received a version optimizing for the negative of the fitness function. A survey with semantic differential questions focused on AI impact, productivity, and user satisfaction was applied. The experimental group's appreciation of the AI suggestions, perceived productivity increase, and satisfaction were significantly higher than those of the control group. From the results, we conclude that the BGT succeeds in assisting the development of biomes, generating products of acceptable quality while reducing the designer's workload. In the future, we expect to confirm these results with a separate group of users evaluating the biomes built using BGT.
Article
Full-text available
This submission comprises the proceedings of the 1st Virtual Imaging Trials in Medicine conference, organized by Duke University on April 22-24, 2024. The listed authors serve as the program directors for this conference. The VITM conference is a pioneering summit uniting experts from academia, industry and government in the fields of medical imaging and therapy to explore the transformative potential of in silico virtual trials and digital twins in revolutionizing healthcare. The proceedings are categorized by the respective days of the conference: Monday presentations, Tuesday presentations, Wednesday presentations, followed by the abstracts for the posters presented on Monday and Tuesday.
Thesis
Full-text available
Optical microscopy is an essential tool for biologists, who are often faced with the need to overcome the spatial and temporal resolution limitations of their devices to capture finer details. As upgrading imaging hardware is expensive, computational methods offer cost-efficient ways to enhance the capabilities of the devices by combining acquisition techniques and post-processing. Despite the freedom offered by mechanized stages and variable intensity lights in modern microscopes, existing custom control solutions do not offer sufficient flexibility to explore various subframe illumination and motion patterns. Moreover, the high computational cost of 3D simulations makes it difficult to characterize imaging setups at scale. The contributions in this thesis address the above issue by introducing illumination control hardware that allows exploiting the optomechanical components commonly found in most imaging platforms to increase their spatial and temporal resolutions through computational imaging approaches. A complete simulation environment accelerated by parallel computing complements the hardware setup. I illustrate the strengths of this framework by imaging biological samples in three applications: focal sheet scanning optical projection tomography, multichannel low-speed cardiac imaging, and optomechanical modulation tomography. As my first contribution, I extend the OpenSPIM microscope, an open light sheet device, to enable sub-frame control of illumination modulation in conjunction with the camera and stage. This allows implementing complex acquisition procedures that require a precisely timed control of the microscope's optomechanical components. Then, I show that illumination shaping using focal plane scanning increases the resolution of optical projection tomography images. This result is supported by my simulation framework, which allows testing a range of optical settings at scale thanks to parallel programming. Next, I take advantage of the subframe illumination capabilities of my system and introduce a method to reconstruct multichannel videos with virtually increased frame rate from single-channel cardiac fluorescence imaging using a low frame rate camera. The proposed method uses a paired acquisition approach that alternates between illumination modalities to allow reconstructing videos with improved temporal resolution in post-processing. Finally, I investigate a compressed sensing method that combines the spatial and temporal aspects of illumination shaping to reconstruct high-resolution volumes from few images. I formulate an efficient 1+2D regularization function that offers high reconstruction fidelity while being fast to compute using parallel computing. In conclusion, this thesis provides hardware and software tools to implement spatiotemporal light modulation methods with good cost efficiency. It shows that the combination of long camera integration times with active illumination modulation or sample movement can be exploited to enhance spatial and temporal resolutions in various biological imaging applications, through the optical computation of continuous integrals.
Article
Full-text available
The aim of this work is to provide a simulation framework for generation of synthetic tomosynthesis images to be used for evaluation of future developments in the field of tomosynthesis. An anthropomorphic software tissue phantom was previously used in a number of applications for evaluation of acquisition modalities and image post-processing algorithms for mammograms. This software phantom has been extended for similar use with tomosynthesis. The new features of the simulation framework include a finite element deformation model to obtain realistic mammographic deformation and projection simulation for a variety of tomosynthesis geometries. The resulting projections are provided in DICOM format to be applicable for clinically applied reconstruction algorithms. Examples of simulations using parameters of a currently applied clinical setup are presented. The overall simulation model is generic, allowing multiple degrees of freedom to cover anatomical variety in the amount of glandular tissue, degrees of compression, material models for breast tissues, and tomosynthesis geometries.
Conference Paper
Full-text available
Procedural methods are a promising but underused alternative to manual content creation. Commonly heard drawbacks are the randomness of and the lack of control over the output and the absence of integrated solutions, although more recent publications increasingly address these issues. This paper surveys procedural methods applied to terrain modelling, evaluating realism of their output, performance and control users can exert over the procedure.
Article
Two deficiencies in the original Noise algorithm are corrected: second order interpolation discontinuity and unoptimal gradient computation. With these defects corrected, Noise both looks better and runs faster. The latter change also makes it easier to define a uniform mathematical reference standard.
Article
Images derived from a "phantom" are useful for characterizing the performance of imaging systems. In particular, the modulation transfer properties of imaging detectors are traditionally assessed by physical phantoms consisting of an edge. More recently researchers have come to realize that quantifying the effects of object variability can also be accomplished with phantoms in modalities such as breast imaging where anatomical structure may be the principal limitation in performance. This has driven development of virtual phantoms that can be used in simulation environments. In breast imaging, several such phantoms have been proposed. In this work, we analyze non-Gaussian statistical properties of virtual phantoms, and compare them to similar statistics from a database of breast images. The virtual phantoms assessed consist of three classes. The first is known as clustered-blob lumpy backgrounds. The second class is "binarized" textures which typically apply some sort of threshold to a stochastic 3D texture intended to represent the distribution of adipose and glandular tissue in the breast. The third approach comes from efforts at the University of Pennsylvania to directly simulate the 3D anatomy of the breast. We use Laplacian fractional entropy (LFE) as a measure of the non-Gaussian statistical properties of each simulation. Our results show that the simulation approaches differ considerably in LFE with very low scores for the clustered-blob lumpy background to very high values for the UPenn phantom. These results suggest that LFE may have value in developing and tuning virtual phantom simulation procedures.
Article
Purpose: The use of contrast agents in breast imaging has the capability of enhancing nodule detectability and providing physiological information. Accordingly, there has been a growing trend toward using iodine as a contrast medium in digital mammography (DM) and digital breast tomosynthesis (DBT). Widespread use raises concerns about the best way to use iodine in DM and DBT, and thus a comparison is necessary to evaluate typical iodine-enhanced imaging methods. This study used a task-based observer model to determine the optimal imaging approach by analyzing six imaging paradigms in terms of their ability to resolve iodine at a given dose: unsubtracted mammography and tomosynthesis, temporal subtraction mammography and tomosynthesis, and dual energy subtraction mammography and tomosynthesis. Methods: Imaging performance was characterized using a detectability index d', derived from the system task transfer function (TTF), an imaging task, iodine signal difference, and the noise power spectrum (NPS). The task modeled a 10 mm diameter lesion containing iodine concentrations between 2.1 mg/cc and 8.6 mg/cc. TTF was obtained using an edge phantom, and the NPS was measured over several exposure levels, energies, and target-filter combinations. Using a structured CIRS phantom, d' was generated as a function of dose and iodine concentration. Results: For all iodine concentrations and dose, temporal subtraction techniques for mammography and tomosynthesis yielded the highest d', while dual energy techniques for both modalities demonstrated the next best performance. Unsubtracted imaging resulted in the lowest d' values for both modalities, with unsubtracted mammography performing the worst out of all six paradigms. Conclusions: At any dose, temporal subtraction imaging provides the greatest detectability, with temporally subtracted DBT performing the highest. The authors attribute the successful performance to excellent cancellation of inplane structures and improved signal difference in the lesion.