An increased popularity which is the stereo
photograph due to availability for the stereoscopic cameras as well as lens
which is also aroused and research of the interest in the image editing of
stereo. In this research paper the objective is to shown the automatic
aesthetic based wrapping methods which are also recompose the right as well as
left stereo image of the pair by using the global optimization algorithm. And
it is also maximizing the image aesthetics which is minimizing the set of
aesthetics errors and it is also formulated that is based on the chosen
photographic composition rules in the wrapping process. Therefore the algorithm
attempts which preserve the stereoscopic properties through the minimizing of
disparity change as well as vertical drift in the resulting image. The experimental result which is also present
the method successfully relocate the salient objects regarding to the chosen
photographic rules and it is also improve the compositional aesthetics as well
as also maintain the disparity consistency to create the comfortable 3D viewing
experience.
Keywords: warping, Aesthetic,
stereoscopic
Introduction of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
The
images are used for a variety of purposes, and there can be situations, where
images are not clear and they are distorted due to a variety of reasons. So, it
is vital to get those images in proper shape so that image is easily identified
with its elements. There is one important and effective process to correct such
images if they need to be expanded or shrink for a variety of purposes, and
this deformation technique is called image warping. It is a digital process, which
is used to manipulate images as per the given requirements. If there are any
kinds of distortions in the images, image warping will be helpful to deal with
those distortions so that image is properly corrected without compromising its
original features. The image warping is used for so many purposes, and one of
them is creativity to make images more attractive and original in shape (Wolberg, 1990)
The
wrapping is the important image processing techniques. It is directly apply to the
existing monocular image warping technique which is the stereoscopic images and
it is problematic which is often introduced the vertical disparities as well as
also damages the original disparity distribution. The research paper also
focused on the stereoscopic image wrapping where the wrapping is the basic
technique and it is also has the wide range image warping methods which have
been developed. By applying the same warping to the right to left image of the
stereoscopic image which could also transform them and thus its straightforward
solution is often the problematic (Niu et al , 2012).
Due
to the stereoscopic availability camera as well as lens along with the display
of stereoscopic , the stereo photography is the aesthetic stereo image which
could also important and improve through the adopting the various photographic
composition rules like the rules of visual balance as well as the rule of thirds.
Thus the amateur stereoscopic photographer which is often unaware of these rule
as well as the techniques of processing which is improve the image and it could
also often be laborious and involves to modifying the just one image which is
the stereo image pair.
There
are some researchers which proposed the stereo image editing tools in the
recent years and these types of tools also simplify the stereo image editing
tasks through the lowing objects where the stereo image is easily selected as
well as modified thus it is ensuring the stereoscopic properties of stereo image
which is applied and preserved in this proves (Chang et al , 2011).
Therefore
the automatic aesthetic driven image which is the recomposition of the tools
and it would also more desirable. Then to know for the best knowledge of the
stereo cropping which is automatic recomposition tool and it is available. Then
this methods is used to cropping approach and it is also recompose the stereo
image thus the salient objects are also recomposed which is based on the chosen
graphic re-compositions rules. Re-composing the images by the sufficient
uninteresting background which is cropped away and thus the cropping method is
also suffer from the loss content as well as it might not work well when the
single object is occupied for the important portions of the stereo image (Niu et al Y.
, 2012).
The
limitations of the stereo cropping is the proposed in the aesthetic driven
re-composition approach which is also based on the image warping technique and
the approach aims is to modify the image composition which is based on the
selected photographic and thus the preserving of the stereoscopic properties of
the stereo image repair (Islam et al , 2015).
Research Background/Literature Review of Using Stereoscopic Image Warping to Enhance the
Composition Aesthetics
According
to the author Lee et al (2012), it is conducted that the Stereo image which is
retargeting the process of resizing of the stereo image pair and it’s also fit
into the target display. The retargeting in the process of modifying of the composition
for the image like it is significant element for the images which is preserved.
Now a days author have proposed an
assortment of techniques, for example carving warping of cropping seam and move
guide to perform retargeting of the stereo image. Every one of these
methodologies has its own quality as well as delivers great retargeting results
for certain classification of image. In any case, every one of these methodologies,
with an exception of doesn’t consider an improvement of aesthetic image during
the retargeting procedure. Author planned an aesthetic driven, trimming based
way to deal with alter an organization of an image dependent on a lot of chosen
photographic standards during a retargeting procedure. This methodology
produces capable outcomes in image by adequate unexciting foundation yet image
fails by numerous subjects just as image by photograph subject that fills the
casing. In ongoing years, an intuitive editing tool of the stereo image is
likewise beginning to pick up consideration. Content-mindful stereoscopic image
altering technique permits clients to intelligently change a structure of a
sound system image through modifying an area, as well as profundities of chose
objects, giving clients stylish control for profundity discernment. A 3D Copy
and Paste strategy allows frontal area objects from a source stereo image to be
duplicated to an objective target stereo image while guaranteeing a subsequent
picture produces agreeable 3D seeing. Then the pasting of the stereo image
method is went step further which is also allows to the objects of 2D and
copied along with blended the stereo image. All the interactive tools which are
used for the experienced photographer and also awarded by the compositional
aesthetic amateur photographer without the knowledge of the aesthetic image
that might be determined the undesirable tools (Lee et al , 2012).
It is vital to understand, why image warping can be
critical in various given perspectives, and one good example to show its
importance in dealing with criminal cases came in 2007 when a pedophile culprit
was searched by the police. The name of the culprit was Christopher Paul Neil,
and he was a sex-offender, who was involved in a production of videos having
online child pornography. But he tried to be smart by distorting his face in
the videos and images by using a swirl technique so that he cannot be identified
by the police or law enforcement agencies. A global campaign was launched to
identify this child sex-offender, but his face was not identifiable. This is
where the digital image warping technique came in handy as German computer
experts started to use this technique so that identifiable images of the
culprit are produced. After a lot of hard work, and by using this digital
technique, the experts were able to produce images, which helped to identify
the man, who was in Thailand. After his identification, Interpol was able to
arrest him from Thailand. He was charged for various offenses and found guilty,
so he was jailed for several years as per court orders. It is one great example
how digital methods such as image warping can be useful for the public, like it
helped police to identify and arrest a child sex-offender, otherwise, he might
have continued to destroy the lives of many other children and young boys (BBC, 2017)
According
to the author Niu et al Y(2012), it is conducted that the stereoscopic image
warping for the monocular image could also defined like the function which is
the maps of pixel position from the output to input. A stereoscopic image has
the third component of uniqueness (profundity). One clear answer for warping of
the stereoscopic image is to apply a similar twisting capacity to both a left
as well as right image. Uniqueness is certainly decided. This arrangement has a
favorable position that a left as well as right image is reliably twisted, plus
yet has two significant restrictions. In a first place, vertical variations can
be presented as a comparing highlight focuses in a left as well as right image
have various arranges along with are
mapped to various areas in spite of a fact that a similar the warping function
is utilized. Second, a dissimilarity map is subjectively changed, harming basic
profundity recognition for review. Our procedure permits existing image
twisting strategies to be applied to stereoscopic image. Rather than distorting
a left as well as right image straightforwardly, our method takes a shot at
both an image as well as the dissimilarity guide to appropriately deal with a
uniqueness issues. Method for stereoscopic image twisting comprises of three
stages after a pre-preparing venture of difference estimation. This method is pre-process
the input of stereoscopic image which is also compute the disparity map. The
pre-pixel disparities could also be estimated in the dense stereo matching that
is also still challenging the computer vision problem (Niu et al Y.
, 2012).
Problem Statement of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
In
this research paper the problem statement is to identify the automatic,
aesthetic-based wrapping approach to recompose the right as well as left stereo
image by using the global optimization algorithm. And also maximize the image aesthetics
for this first of all minimize the set of aesthetics errors which is formulated
based on selected photographic composition.
Research Objective of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
In
this research paper the objective of research is automatically improve the
aesthetics of the stereoscopic image through minimizing the set of the
aesthetic error and wrapping. It will help to get new ideas in the process, and
it will look at more elements to explore more opportunities for the process of stereoscopic
image warping, which can be used for a variety of purposes.
Research Questions of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
How improve the
aesthetics of stereoscopic image by minimizing set of aesthetic error and
wrapping?
How identify the
automatic, aesthetic-based wrapping approach to recompose the right as well as
left stereo image by using the global optimization algorithm?
Significance of the Research of Using Stereoscopic Image Warping to Enhance the
Composition Aesthetics
Due
to affordability as well as availability of the stereoscopic equipment’s where
the manipulations of stereoscopic image is also received the supposed research
attention in the present years. The semi-automatic and the aesthetic driven
stereoscopic image where the approach of re-composition which capacitates of
the change with the spatial position of the foreground is given in the
stereoscopic image and also improves the human visual aesthetics (Low et al ,
2018).
This research is going to be significant to explore more elements of
Stereoscopic Image Warping so that Composition Aesthetics are enhanced in the
best possible manner. This research will allow looking at any limitations or
issues in the process so that solutions are found to make this process more
useful and effective for image warping.
Research Methodology
of Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
In this research paper the
methodology has main two parts
·
Pre-processing
·
Error formulation and
optimization
Figure: Overall pipeline
of proposed system
Pre-processing
of Using Stereoscopic Image Warping to
Enhance the Composition Aesthetics
From
the stereo image compute the disparity map by using the Sum of Absolute Difference.
Then next we also construct the triangular mesh over the left stereo image then
it is also generate an importance of maps by using the graph which is based on the
visual saliency algorithm (Itti et al , 2000). The triangle which is given in the triangular
meshes and it is also corresponds the area of the high saliency which is very significant
and the importance of the maps are also marked like the salient triangular.
Error
formulation and optimization of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
Warping Errors
Let
L and R indicate a left as well as right image individually. In the procedure
of warping, a source triangular lattices,
and
are
mapped to a objective cross sections
and
. An arrangement of triangles and articles
in
are T and O individually. A warping quality
mistakes is a defined as a weighted aggregate of scale change blunder,
perfection blunder, as well as stereoscopic error.
The
scale of transformation error for the every triangle
then we performed the non-uniform scaling
which is the scale transformation error of
is
defined as;
Whereas the
is the corresponding weights
Discrepancy should be considered in an aesthetic guidelines
execution. A Discrepancy worth can be positive or negative, presenting whether a
specific point in a stereo image is situated behind or before the screen. So as
to transfer an object to a progressively precise force point or electrical
cable area, we repay the divergence variety by subtracting or including half of
the centroid Discrepancy value from the item centroid as needs be.
The rule of third error is defined a s;
is the
total warping error as well as
total aesthetic error.
Results
implementation of Using
Stereoscopic Image Warping to Enhance the Composition Aesthetics
A minimization of an absolute
error work in the above equations is a quadratic function of convex. A error of
warping loads α, β as well as γ are set
to 1, 0.5 and 0.1 individually in our analysis. An error quality of aesthetic
loads δ is set to 0.8 plus the η is set to 0.5 for better piece style. The
author could also permit to alter a loads; δ and η so as to modify a
organization to suit their proclivities. These loads rely upon a size as well
as position of frontal area objects. In below figure, we contrast our outcomes
created as well as without minimization of a stereoscopic error.
Figure: (left) Input stereo
image, (middle) our results without disparity preservation
Clearly a divergence isn't saved,
as well as profundity observation is lost if stereoscopic properties isn't
considered during an advancement. Then again, through remembering a
stereoscopic error for an optimization, a divergence of a yield image is very
much protected. Then an adherence of our outcomes to a chose photographic
creation rules. Our recomposition brings about in the below figure outlines
that our methodology effectively re-positions a photograph subject closer to
one of a force focuses or electrical cables delineated by a third rule.
Figure 6: Results that adhere to
rule of thirds. (Column 1, 2) Input left and stereo (red-cyan) image.
Conclusion of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
After analyzing all the possible elements
in this research, and after conducting the research with its research
methodology, it can be said that automatic aesthetic based warping is one of
the best methods. Summing up all the discussion it is concluded that in this
research paper the automatic aesthetic based warping method is proposed and
also re-compose the stereoscopic image by using the global optimization algorithm.
Then it is also maximizing the image which is the aesthetic and it minimizes
the set of the aesthetic errors which is formulated on the basis of the chosen
photograph and the composition rules in the process of warping. Then therefore
the algorithm attempts to preserve the properties of stereoscopic properties
through the minimizing of the change of disparity as well as the vertical drift
by the resulting image. The experimental result also present the method which
is successfully relocate the salient object regarding to the chosen photograph
and it is also maintain the consistency to create the comfortable 3D experience
of viewing. The stereo-cropping method which could better preserve and the
context of the leading to reduced the content loss. Then their drawback of the
methods also involves the unavoidable distortion features in the stereo image by
the complex background. In this research paper the algorithms also preserves the
vertical drift as well as the limit is relocate of the objects which of present
in the current depth location. However, this research is a good roadmap for the
researchers to look into it for finding more opportunities and methods with
regards to image warping.
References of
Using Stereoscopic Image Warping to Enhance the Composition Aesthetics
BBC. (2017). 'Swirl face' sexual offender in
Vancouver after release. Retrieved May 31, 2020, from https://www.bbc.com/news/world-us-canada-39411025
Chang et al , C. (2011). Content-aware display
adaptation and interactive editing for stereoscopic images. IEEE TMM,
589–601,.
Islam et al , M. B. (2015). Stereoscopic ImageWarping
for Enhancing Composition Aesthetics. 3rd IAPR Asian Conference on Pattern
Recognition (ACPR).
Itti et al , L. (2000). A Model of Saliency-Based
Visual Attention for Rapic Scene Analysis. IEEE TPAMI, 1254–1259.
Lee et al , K.-Y. (2012). Scene warping: Layer-based
stereoscopic image resizing. IEEE CVPR, 49–56.
Low et al , K. -L. (2018). Aesthetics-Driven
Stereoscopic 3D Image Recomposition with Depth Adaptation. IEEE.
Niu et al , Y. (2012). Aestheticsbased stereoscopic
photo cropping for heterogeneous displays. IEEE TMM, 783–796.
Niu et al , Y. (2012). Enabling Warping on
Stereoscopic Images. Proceedings of ACM SIGGRAPH Asia.
Wolberg, G. (1990). Digital image warping
(illustrated Edition ed.). IEEE Computer
Society Press.