Journal of Minimally Invasive Surgery 2023; 26(3): 134-145
Published online September 15, 2023
https://doi.org/10.7602/jmis.2023.26.3.134
© The Korean Society of Endo-Laparoscopic & Robotic Surgery
Correspondence to : Symeonidou Elissavet
5th Department of Surgery, Ippokratio General Hospital, Aristotle University of Thessaloniki, Konstantinoupoleos 49, Thessaloniki 54642, Greece
E-mail: ellie.simeonidou@gmail.com
https://orcid.org/0000-0001-7297-841X
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Purpose: The robotic approach offers improved visualization and maneuverability for surgeons. This systematic review aims to compare the outcomes of robotic-assisted and conventional laparoscopic approaches for paraesophageal hernia repair, specifically examining postoperative complications, operative time, hospital stay, and recurrence.
Methods: A systematic review including thorough research through PubMed, Scopus, and Cochrane, was performed and only comparative studies were included. Studies concerning other types of hiatal hernias or children were excluded. A meta-analysis was conducted to compare overall postoperative complications, hospital stay, and operation time.
Results: Ten comparative studies, with 186,259 participants in total, were included in the meta-analysis, but unfortunately, not all of them reported all the outcomes under question. It appeared that there is no statistically significant difference between the conventional laparoscopic and the robotic-assisted approach, regarding the overall postoperative complication rate (odds ratio [OR], 0.56, 95% confidence interval [CI], 0.28–1.11), the mean operation time (t = 1.41; 95% CI, –0.15–0.52; p = 0.22), and the hospital length of stay (t = –1.54; degree of freedom = 8; 95% CI, –0.53–0.11; p = 0.16). Only two studies reported evidence concerning the recurrence rates.
Conclusion: Overall, the robotic-assisted method did not demonstrate superiority over conventional laparoscopic paraesophageal hiatal hernia repair in terms of postoperative complications, operation time, or hospital stay. However, some studies focused on cost and patient characteristics of each group. Further comparative and randomized control studies with longer follow-up periods are needed for more accurate conclusions on short- and long-term outcomes.
Keywords Paraesophageal, Hiatal hernia, Laparoscopy, Robotics, Mesh
Minimal-invasive surgery has become the treatment of choice in many abdominal procedures, including hiatal hernia repair since it is associated with less postoperative pain, easier mobilization of the patient, and shorter hospital lengths of stay. Laparoscopic hiatal hernia repair is a time-consuming and technically demanding procedure, commonly accepted to have two major disadvantages; the lack of depth perception because of the two-dimensional imaging, and limited maneuverability. On the other hand, the robotic-assisted approach offers better ergonomic conditions, a three-dimensional view, better access to the mediastinum, and a wide range of motions, wrist-like movements of the instruments, significantly useful for suturing or mesh placement, but it is also associated with a higher cost. The aim of this systematic review and meta-analysis is to find out whether robotic-assisted paraesophageal hernia repair is superior to conventional laparoscopic in terms of morbidity and operation time, and therefore worth the cost. The PICO criteria were used in order to conduct the scientific question: Is the robotic approach (Intervention) superior to laparoscopic (Comparison) in male and female patients with hiatal hernia, who are older than 18 years (Population), in terms of postoperative complications, length of stay (LOS), operative time and recurrence rates (Outcomes)?
Only comparative studies of robotic and laparoscopic paraesophageal hernia repair in adults were included in the study.
Case reports, small case series, articles not in the English language, as well as articles concerning patients younger than 18 years old were excluded from the study. In addition, articles about other types of diaphragmatic hernia repair like Morgagni, Bochdalek, iatrogenic, and postesophageal, are excluded from this study.
From December 1, 2022 to December 31, 2022, a comprehensive literature search of MEDLINE, Scopus, and the Cochrane Library was conducted, using the keywords robotic AND laparoscopic AND hernia AND (hiatal OR paraesophageal OR diaphragmatic). The evaluation of the studies was performed by two reviewers who worked independently. Cohen’s kappa was calculated at 98.6%, indicating an almost perfect level of agreement [1]. The search strategy algorithm and the data extraction are illustrated in Fig. 1. Most of the studies included in this systematic review are single-center retrospective studies or observational cohorts selected from databases where the data were registered prospectively. No randomized control studies are reported in the literature. For this reason, the risk of bias in literature, unfortunately, exists, especially regarding indication and selection bias. The design of the study was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. No automation tools were used. The study focuses on the hiatal hernia repair, not the fundoplication technique.
IBM SPSS version 29.0 (IBM Corp.) was used for the meta-analysis and the results are presented in Forest plots. Egger test was used to estimate publication bias, which is illustrated in funnel plots. Any missing results were excluded from the analysis. The ReviewManager (RevMan) calculator version 5.2, a useful tool provided by the Cochrane Library, was used to estimate missing standard deviations in cases of continuous variables. The random effects model was used for continuous or binary variables and the effect was considered statistically significant when the
The overall postoperative complications, the mean operation time, the hospital LOS, the estimated blood loss, and the recurrence rates, are the outcomes intended to be studied in this review. The data collected from the studies included in the review are presented in Tables 1, 2, and 3.
Only six studies provided enough evidence about the overall postoperative complication rates, as illustrated in Table 1.
Ward et al. [3] published the study with the most participants, from the National Inpatient Sample database during the time period 2010–2015, and reported that the complications in the robotic group were significantly higher odds ratio (OR) (1.17; 95% CI, 1.07–1.27), and specifically respiratory failure (OR, 1.68; 95% CI, 1.37–2.05) and esophageal perforation (OR, 2.19; 95% CI, 1.42–3.93), even in high volume centers. On the other hand, Soliman et al. [4] reported that older age and laparoscopic approach were associated with more postoperative complications, but it was not a randomized study. Meta-analysis for categorical data was performed, according to the meta-analysis, there was no statistically important difference considering the overall postoperative complications rates between laparoscopic and robotic hiatal hernia repair. A random effects model was applied; OR, 0.56 (95% CI, 0.28–1.11), without any statistical significance. A
Some of the most frequent complications are dysphagia, pleural effusion [5], pneumonia, venous thromboembolism, cardiac failure [3], atrial fibrillation [6], atelectasis, delayed gastric emptying, wound infections [7], thoracic or abdominal infections [6], and mediastinitis.
Regarding intraoperative complications, the most common are bleeding [5], perforation [8], and pneumothorax [7]. The important information missing from the majority of the studies is the type of fundoplication used and whether a mesh was placed or not.
Another area of interest is whether robotic-assisted hiatal hernia repair is related to shorter hospital LOS. Nine out of 10 studies provided data about the LOS, as shown in Table 2.
There was no statistically significant publication bias (
Although the meta-analysis proved equivalent results regarding the LOS, a considerable number of studies, as shown in Table 2, reported shorter hospitalization in the robotic group. A different adaptation of ERAS (Enhanced Recovery After Surgery) protocols might be the explanation for this fact [9].
Concerning the mean operation time, only six studies provided information about this outcome, as indicated in Table 3.
There is no significantly important difference concerning the operation time between robot-assisted and laparoscopic hiatal hernia repair (t = 1.41, df = 5; 95% CI, –0.15 to 0.52;
In general, the use of mesh is a very important element for hiatal hernia reconstruction, but unfortunately, few studies provide evidence about this factor. Soliman et al. [4] reported that mesh was used in only four of a total of 293 patients. O’Connor et al. [9] reported that mesh placement was performed more frequently in the laparoscopic group with a
Only three studies provided evidence in regard to estimated blood loss. Gehrig et al. [7] stated that there is no statistically important difference between the laparoscopic and robotic groups.
Not enough data were provided concerning the recurrence rates in order to perform the meta-analysis. Only O’Connor et al. [9] stated that the robotic group had a lower radiologic recurrence rate (13.3% compared to 32.8% in the laparoscopic group with a
Unfortunately, all of the studies included in the meta-analysis are retrospective and none of them is randomized. Due to the considerable heterogeneity, the results of the meta-analysis are not reliable. Further studies and especially randomized control studies are needed in order to reach reliable conclusions.
Robotic-assisted surgery is becoming more and more popular among surgeons since it overcomes the technical difficulties of conventional laparoscopy. Its safety and efficacy have been proven even for oncologic procedures, while its cost has been justified for procedures with limited anatomic space, such as radical prostatectomy, low anterior resection, and bariatric procedures. Especially for the paraesophageal hernia repair, which is a technically challenging procedure, demanding high mediastinal dissection, complete removal of the hernia sac, a low-tension hiatal reconstruction with sutures, with or without mesh placement, robotic technology seems a very useful tool to overcome these difficulties, restricting the need to conversion to open surgery [11,12]. However, according to the presented meta-analysis, the short-term outcomes with regard to operation time, LOS, and postoperative complications are equivalent, whereas there is not enough data in the literature concerning the long-term outcomes and specifically the recurrence rates.
Robotic approach might be very useful for the repair of recurrent or complex hiatal hernias [9], which are accompanied by higher morbidity and mortality as well as less satisfactory symptomatic outcome [13]. Seetharamaiah et al. [14] reported a series of 19 robotic repairs of giant paraesophageal hernias, with only two surgery-related complications, one conversion to open approach and no recurrence in a mean follow-up period of 15.6 months. Taking into consideration that the majority of complications are pulmonary events and pneumonia, the robotic approach enables better visualization and ergonomics during the dissection of the hernia sac from the delicate pleura [9]. In addition, it provides high-quality hiatal reconstruction and suturing even in the reoperative field, which is characterized by changed anatomical planes and demands extensive adhesiolysis. As a result, the surgeons, being aware of the capabilities of the robot, feel more confident, a fact which explains the lower conversion to open procedure rates for redo hiatal hernias [13]. The conversion rate for redo hiatal hernias with the laparoscopic approach might be as high as 11% [15]. Gerull et al. [10] also reported a higher percentage of redo hernias in the robotic group, as well as a lower percentage of esophageal lengthening procedure, such as Collis gastroplasty and wedge fundectomy. Mertens et al. [6] presented a large series of both primary and redo robotic-assisted hiatal hernia repair with major complication rate up to 5.2% and 2.6% respectively, while the incidence of complications of any severity were 17.1% and 10.6%, indicating that the low number of complications in the redo group was not significantly different from the primary procedure group. The presence of strong adhesions and the strangulation of a significant portion of abdominal viscera consist the two main reasons for conversion in the robotic group [6]. Sowards et al. [16] mentioned longer operative times, increased hospital LOS, and the use of mesh in the recurrent group compared to the primary group, with no significant difference in intraoperative complications, estimated blood loss, or postoperative dysphagia, while no conversion was noticed. On the other hand, a single-center retrospective study by Tolboom et al. [13] reported a significant reduction in conversion rates and in hospitalization time in the robotic-assisted redo group, whereas the most common complication was the perforation of the esophagus or the stomach. Nevertheless, previous laparoscopic antireflux surgery does not suggest an indication for open approach in case of recurrence; if a robotic platform is available in combination with an experienced surgical team, a robotic approach is recommended.
Experience from robotic redo hiatal hernia repair after primary robotic procedure is provided by Arcerito et al. [17], who mentioned the increased possibility of conversion to open approach due to the severe scar tissue lying between hiatal crura and fundoplication, which developed more likely from the placement of an absorbable mesh. However, no mesh-related complications are mentioned during a two-and-a-half-year time period [17], thanks to the absorbable property, even in longer follow-up periods [18].
Regarding the learning curve, it is believed that the robotic approach has a shorter learning curve compared to laparoscopy for advanced surgical procedures, while a significant case volume and dedicated operation room staff can significantly reduce the operation time [19]. Galvani et al. [20], in a large cohort of 61 robotic procedures all performed by one surgeon, claimed a learning curve of 36 cases, comparable to conventional laparoscopy. Sarkaria et al. [12] in a series of 24 patients, noticed that the operation time was decreased by 98 minutes between the second and the first half of the series. Washington et al. [21] also reported shorter operative time between the early and the late robotic experience, 184 and 142 minutes respectively, as well as a significant decrease in conversion rates, after only one year of thirteen robotic procedures.
Another topic of interest is the application of the robotic platform in the emergency setting in cases of strangulation of hernia contents. According to a study published by Hosein et al. [22], minimally invasive approaches predominate even in the urgent setting, with better postoperative outcomes, with the open approach being selected only for extremely ill patients. The robotic approach was superior to the open one for mild to moderate ill patients, but not superior to the laparoscopic approach. In another study by Vasudevan et al. [19], 40% of the robotic procedures were performed on patients presenting with acute symptoms and neither higher operative time nor conversions were observed in comparison to elective cases. Arcerito et al. [17] also suggested the robotic approach for the treatment of acutely presented hiatal hernias even on admission day. Equivalent outcomes were noticed even for complete upside-down stomach hiatal hernias [23]. Because of the higher cost, the robotic approach is reserved for giant or revisional hiatal hernias in some centers [22].
Regarding the recurrence rates, there is not enough evidence in the literature concerning the long-term outcomes. Mertens et al. [6] reported two cases of early symptomatic recurrence requiring redo surgery during the 30-day postoperative period. Draaisma et al. [24] reported a low midterm recurrence rate after 1 year of follow-up. Brenkman et al. [25], in a cohort of 40 patients and during an 11-month follow-up period, reported only one symptomatic recurrence (2.5%). He attributed this result to the application of the robotic platform and the Toupet-fundoplication, which attached to the crus, provides further support to the hiatal repair, while no mesh was placed. Galvani et al. [20] in a cohort of 61 patients, where mesh was used in all cases, and during a median follow-up period of 24 months, reported a radiologic recurrence rate up to 42%, pointing out that the majority of the patients were asymptomatic and indicating than the durability of the repair decreases over time. Arcerito et al. [17] also provided promising evidence regarding the long-term recurrence rate during two-and-a-half years of follow-up. In one of the largest studies with paraesophageal hiatal hernia repair by Gerull et al. [11], a radiographic recurrence rate of only 9% during 5 years of observation is reported, in combination with clinically significant quality of life benefits. The presentation of recurrence may not solely depend on the surgical technique but also on the presence of ultrastructural abnormalities in the muscular tissue of the crura in patients with hiatal hernia. These patients often exhibit a high incidence of severe muscular lesions, which are not observed in individuals with a normal gastroesophageal junction [26]. This evidence supports the application of mesh in order to strengthen the hiatal repair and lower the recurrence rates.
Robotic procedures in general are associated with higher costs. Interestingly, Gerull et al. [11] reported that the operation equipment costs were similar between robotic and traditional laparoscopic paraesophageal hernia repair, with a mean difference of only $89. Lekarczyk et al. [27] found similar hospital profits for the robotic group despite higher supply costs and charges. However, Kulshrestha et al. [28], in a study with more participants, reported that both open and robotic-assisted procedures had significantly higher median index hospitalization costs compared to laparoscopic ones. The most common reasons that increased the cost were upper endoscopy and reoperation, followed by emergent priority, increased comorbidity index, and LOS. Hosein et al. [22] also demonstrated that the laparoscopic approach was the least expensive. However, the increased experience of the surgeons with the robotic platform, which will lead to fewer complications, LOS, and postoperative exams, as well as the fact that the cost of the robotic equipment will go down over time, might diminish this difference in the future.
The robotic platform has been used successfully for the repair of other diaphragmatic hernias, such as Morgagni [29,30], Bochdalek [31], and even postesophagectomy hiatal hernias [32], indicating its potential in technically demanding procedures.
Over the last decades, esophageal surgery has evolved from open approaches including both laparotomy and thoracotomy to minimally invasive procedures. The robotic-assisted hiatal hernia repair is superior to the traditional open approach in terms of overall complication rate, mortality [20], postoperative pain, and hospital LOS. However, its superiority over conservative laparoscopy has not been proven yet.
The present meta-analysis did not demonstrate any advantage of the robotic-assisted paraesophageal hernia repair over the conventional laparoscopic approach, which remains the most cost-effective approach. Robotic paraesophageal hernia repair is safe and feasible, but still not superior to laparoscopy, unless in cases with recurrent complex hernias. It is obvious that more comparative and mainly randomized control studies with subgroup analysis need to be performed in order to reach more accurate conclusions and find out which patients would benefit most. A long-term follow-up of the patients is essential because there is a lack of evidence in the literature concerning the recurrence rates of each approach.
Ethical statements
This systematic review and meta-analysis were conducted in accordance with ethical principles and guidelines. As this study is based on literature review, institutional ethics committee approval was not required.
Authors’ contributions
Conceptualization, Investigation, Methodology, Software: SE
Data curation, Validation: GI
Formal analysis: KA
Supervision, Resources: MK
Project administration: KA
Visualization: PP
Writing–original draft: SE
Writing–review & editing: PP
All authors read and approved the final manuscript.
Conflict of interest
All authors have no conflicts of interest to declare.
Funding/support
None.
Data availability
The data presented in this study are available on request from the corresponding author.
Data for postoperative complications
Study | Year | Nation | Study design | Participants (n) | Overall postoperative complications (n) | OR (95% CI) | ||||
---|---|---|---|---|---|---|---|---|---|---|
Laparoscopy | Robotic | Laparoscopy | Robotic | |||||||
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 12 | 2 | 1 | 0.68 (0.05–8.5) | 0.765 | |
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 142 | 29 | 9 | 0.28 (0.13–0.63) | 0.001 | |
Ward et al. [3] | 2021 | United States | Retrospective database analysis | 158,432 | 9,897 | 17,843 | 1,321 | 1.21 (1.14–1.29) | 0.005 | |
Hosein et al. [22] | 2021 | United States | Retrospective database analysis | 6,774 | 835 | 250 | 16 | 0.51 (0.31–0.85) | 0.05 | |
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 55 | 11 | 6 | 0.82 (0.29–2.37) | 0.8 | |
Tjeerdsma et al. [8] | 2022 | United States | Single-center retrospective analysis | 42 | 16 | 15 | 5 | 0.24 (0.08–0.75) | 0.749 |
OR, odds ratio; CI, confidence interval.
Data for the length of stay, the estimated blood loss, and the recurrence rates
Study | Year | Nation | Study design | Participants (n) | Length of stay (day) | Estimated blood loss (mL) | Recurrence rates (%)a) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Laparoscopy | Robotic | Laparoscopy | Robotic | Laparoscopy | Robotic | Laparoscopy | Robotic | ||||||||||
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 12 | 6.5 ± 1.6 (IQR, 5–10) | 7.8 ± 3.9 (IQR, 5–19) | 0.272 | 24 ± 42 (IQR, 0–150) | 33 ± 85 (IQR, 0–300) | 0.742 | ||||||
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 142 | 1.8 ± 1.5 | 1.3 ±1.8 | 0.003 | |||||||||
O'Connor et al. [9] | 2020 | United States | Single-center retrospective analysis | 278 | 114 | 3.3 | 2.3 | 0.003 | 32.8 | 13.3 | 0.008 | ||||||
Gerull et al. [10] | 2021 | United States | Retrospective database analysis | 1,024 | 830 | 2.9 ± 1.4 | 1.8 ± 0.6 | 0.001 | 89.3 ± 27.8 | 27.3 ± 5.9 | 0.001 | ||||||
Hosein et al. [22] | 2021 | United States | Retrospective database analysis | 6,774 | 835 | 3.9 | 3.44 | ||||||||||
Kulshrestha et al. [28] | 2021 | United States | Retrospective database analysis | 5,962 | 1,520 | 2 (IQR, 1–4) | 3 (IQR, 2–5) | 0.001 | |||||||||
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 55 | 4 (3.8–4.2) | 3.6 (3.4–3.8) | 0.2 | 44.2 | 57.2 | 0.25 | ||||||
Lekarczyk et al. [27] | 2023 | United States | Single-center retrospective analysis | 42 | 31 | 2.55 | 2 | 0.09 | |||||||||
Tjeerdsma et al. [8] | 2022 | United States | Single-center retrospective analysis | 42 | 16 | 2.5 (1–4) | 3 (2–5.75) | 0.301 |
IQR, interquartile range.
a)One-year follow-up.
Data for operation time
Study | Year | Nation | Study design | Laparoscopic (n) | Operation time (min) | Robotic (n) | Operation time (min) | |
---|---|---|---|---|---|---|---|---|
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 168 ± 42 (IQR, 130–290) | 12 | 172 ± 31 (IQR, 115–120) | 0.785 |
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 158 (IQR, 132–188) | 142 | 186.5 (IQR, 152–232) | 0.001 |
O'Connor et al. [9] | 2020 | United States | Single-center retrospective study | 278 | 175 | 114 | 179 | 0.681 |
Gerull et al. [10] | 2021 | United States | Retrospective database review | 1,024 | 187.3 ± 65.3 | 830 | 174.1 ± 63.8 | 0.001 |
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 125 ± 35.5 | 55 | 149 ± 42.1 | 0.01 |
Lekarczyk et al. [27] | 2023 | United States | Single-center retrospective analysis | 42 | 256.7 | 31 | 257.6 | 0.48 |
IQR, interquartile range.
Journal of Minimally Invasive Surgery 2023; 26(3): 134-145
Published online September 15, 2023 https://doi.org/10.7602/jmis.2023.26.3.134
Copyright © The Korean Society of Endo-Laparoscopic & Robotic Surgery.
Symeonidou Elissavet , Gkoutziotis Ioannis , Petras Panagiotis , Mpallas Konstantinos, Kamparoudis Apostolos
5th Department of Surgery, Ippokratio General Hospital, Aristotle University of Thessaloniki, Thessaloniki, Greece
Correspondence to:Symeonidou Elissavet
5th Department of Surgery, Ippokratio General Hospital, Aristotle University of Thessaloniki, Konstantinoupoleos 49, Thessaloniki 54642, Greece
E-mail: ellie.simeonidou@gmail.com
https://orcid.org/0000-0001-7297-841X
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Purpose: The robotic approach offers improved visualization and maneuverability for surgeons. This systematic review aims to compare the outcomes of robotic-assisted and conventional laparoscopic approaches for paraesophageal hernia repair, specifically examining postoperative complications, operative time, hospital stay, and recurrence.
Methods: A systematic review including thorough research through PubMed, Scopus, and Cochrane, was performed and only comparative studies were included. Studies concerning other types of hiatal hernias or children were excluded. A meta-analysis was conducted to compare overall postoperative complications, hospital stay, and operation time.
Results: Ten comparative studies, with 186,259 participants in total, were included in the meta-analysis, but unfortunately, not all of them reported all the outcomes under question. It appeared that there is no statistically significant difference between the conventional laparoscopic and the robotic-assisted approach, regarding the overall postoperative complication rate (odds ratio [OR], 0.56, 95% confidence interval [CI], 0.28–1.11), the mean operation time (t = 1.41; 95% CI, –0.15–0.52; p = 0.22), and the hospital length of stay (t = –1.54; degree of freedom = 8; 95% CI, –0.53–0.11; p = 0.16). Only two studies reported evidence concerning the recurrence rates.
Conclusion: Overall, the robotic-assisted method did not demonstrate superiority over conventional laparoscopic paraesophageal hiatal hernia repair in terms of postoperative complications, operation time, or hospital stay. However, some studies focused on cost and patient characteristics of each group. Further comparative and randomized control studies with longer follow-up periods are needed for more accurate conclusions on short- and long-term outcomes.
Keywords: Paraesophageal, Hiatal hernia, Laparoscopy, Robotics, Mesh
Minimal-invasive surgery has become the treatment of choice in many abdominal procedures, including hiatal hernia repair since it is associated with less postoperative pain, easier mobilization of the patient, and shorter hospital lengths of stay. Laparoscopic hiatal hernia repair is a time-consuming and technically demanding procedure, commonly accepted to have two major disadvantages; the lack of depth perception because of the two-dimensional imaging, and limited maneuverability. On the other hand, the robotic-assisted approach offers better ergonomic conditions, a three-dimensional view, better access to the mediastinum, and a wide range of motions, wrist-like movements of the instruments, significantly useful for suturing or mesh placement, but it is also associated with a higher cost. The aim of this systematic review and meta-analysis is to find out whether robotic-assisted paraesophageal hernia repair is superior to conventional laparoscopic in terms of morbidity and operation time, and therefore worth the cost. The PICO criteria were used in order to conduct the scientific question: Is the robotic approach (Intervention) superior to laparoscopic (Comparison) in male and female patients with hiatal hernia, who are older than 18 years (Population), in terms of postoperative complications, length of stay (LOS), operative time and recurrence rates (Outcomes)?
Only comparative studies of robotic and laparoscopic paraesophageal hernia repair in adults were included in the study.
Case reports, small case series, articles not in the English language, as well as articles concerning patients younger than 18 years old were excluded from the study. In addition, articles about other types of diaphragmatic hernia repair like Morgagni, Bochdalek, iatrogenic, and postesophageal, are excluded from this study.
From December 1, 2022 to December 31, 2022, a comprehensive literature search of MEDLINE, Scopus, and the Cochrane Library was conducted, using the keywords robotic AND laparoscopic AND hernia AND (hiatal OR paraesophageal OR diaphragmatic). The evaluation of the studies was performed by two reviewers who worked independently. Cohen’s kappa was calculated at 98.6%, indicating an almost perfect level of agreement [1]. The search strategy algorithm and the data extraction are illustrated in Fig. 1. Most of the studies included in this systematic review are single-center retrospective studies or observational cohorts selected from databases where the data were registered prospectively. No randomized control studies are reported in the literature. For this reason, the risk of bias in literature, unfortunately, exists, especially regarding indication and selection bias. The design of the study was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. No automation tools were used. The study focuses on the hiatal hernia repair, not the fundoplication technique.
IBM SPSS version 29.0 (IBM Corp.) was used for the meta-analysis and the results are presented in Forest plots. Egger test was used to estimate publication bias, which is illustrated in funnel plots. Any missing results were excluded from the analysis. The ReviewManager (RevMan) calculator version 5.2, a useful tool provided by the Cochrane Library, was used to estimate missing standard deviations in cases of continuous variables. The random effects model was used for continuous or binary variables and the effect was considered statistically significant when the
The overall postoperative complications, the mean operation time, the hospital LOS, the estimated blood loss, and the recurrence rates, are the outcomes intended to be studied in this review. The data collected from the studies included in the review are presented in Tables 1, 2, and 3.
Only six studies provided enough evidence about the overall postoperative complication rates, as illustrated in Table 1.
Ward et al. [3] published the study with the most participants, from the National Inpatient Sample database during the time period 2010–2015, and reported that the complications in the robotic group were significantly higher odds ratio (OR) (1.17; 95% CI, 1.07–1.27), and specifically respiratory failure (OR, 1.68; 95% CI, 1.37–2.05) and esophageal perforation (OR, 2.19; 95% CI, 1.42–3.93), even in high volume centers. On the other hand, Soliman et al. [4] reported that older age and laparoscopic approach were associated with more postoperative complications, but it was not a randomized study. Meta-analysis for categorical data was performed, according to the meta-analysis, there was no statistically important difference considering the overall postoperative complications rates between laparoscopic and robotic hiatal hernia repair. A random effects model was applied; OR, 0.56 (95% CI, 0.28–1.11), without any statistical significance. A
Some of the most frequent complications are dysphagia, pleural effusion [5], pneumonia, venous thromboembolism, cardiac failure [3], atrial fibrillation [6], atelectasis, delayed gastric emptying, wound infections [7], thoracic or abdominal infections [6], and mediastinitis.
Regarding intraoperative complications, the most common are bleeding [5], perforation [8], and pneumothorax [7]. The important information missing from the majority of the studies is the type of fundoplication used and whether a mesh was placed or not.
Another area of interest is whether robotic-assisted hiatal hernia repair is related to shorter hospital LOS. Nine out of 10 studies provided data about the LOS, as shown in Table 2.
There was no statistically significant publication bias (
Although the meta-analysis proved equivalent results regarding the LOS, a considerable number of studies, as shown in Table 2, reported shorter hospitalization in the robotic group. A different adaptation of ERAS (Enhanced Recovery After Surgery) protocols might be the explanation for this fact [9].
Concerning the mean operation time, only six studies provided information about this outcome, as indicated in Table 3.
There is no significantly important difference concerning the operation time between robot-assisted and laparoscopic hiatal hernia repair (t = 1.41, df = 5; 95% CI, –0.15 to 0.52;
In general, the use of mesh is a very important element for hiatal hernia reconstruction, but unfortunately, few studies provide evidence about this factor. Soliman et al. [4] reported that mesh was used in only four of a total of 293 patients. O’Connor et al. [9] reported that mesh placement was performed more frequently in the laparoscopic group with a
Only three studies provided evidence in regard to estimated blood loss. Gehrig et al. [7] stated that there is no statistically important difference between the laparoscopic and robotic groups.
Not enough data were provided concerning the recurrence rates in order to perform the meta-analysis. Only O’Connor et al. [9] stated that the robotic group had a lower radiologic recurrence rate (13.3% compared to 32.8% in the laparoscopic group with a
Unfortunately, all of the studies included in the meta-analysis are retrospective and none of them is randomized. Due to the considerable heterogeneity, the results of the meta-analysis are not reliable. Further studies and especially randomized control studies are needed in order to reach reliable conclusions.
Robotic-assisted surgery is becoming more and more popular among surgeons since it overcomes the technical difficulties of conventional laparoscopy. Its safety and efficacy have been proven even for oncologic procedures, while its cost has been justified for procedures with limited anatomic space, such as radical prostatectomy, low anterior resection, and bariatric procedures. Especially for the paraesophageal hernia repair, which is a technically challenging procedure, demanding high mediastinal dissection, complete removal of the hernia sac, a low-tension hiatal reconstruction with sutures, with or without mesh placement, robotic technology seems a very useful tool to overcome these difficulties, restricting the need to conversion to open surgery [11,12]. However, according to the presented meta-analysis, the short-term outcomes with regard to operation time, LOS, and postoperative complications are equivalent, whereas there is not enough data in the literature concerning the long-term outcomes and specifically the recurrence rates.
Robotic approach might be very useful for the repair of recurrent or complex hiatal hernias [9], which are accompanied by higher morbidity and mortality as well as less satisfactory symptomatic outcome [13]. Seetharamaiah et al. [14] reported a series of 19 robotic repairs of giant paraesophageal hernias, with only two surgery-related complications, one conversion to open approach and no recurrence in a mean follow-up period of 15.6 months. Taking into consideration that the majority of complications are pulmonary events and pneumonia, the robotic approach enables better visualization and ergonomics during the dissection of the hernia sac from the delicate pleura [9]. In addition, it provides high-quality hiatal reconstruction and suturing even in the reoperative field, which is characterized by changed anatomical planes and demands extensive adhesiolysis. As a result, the surgeons, being aware of the capabilities of the robot, feel more confident, a fact which explains the lower conversion to open procedure rates for redo hiatal hernias [13]. The conversion rate for redo hiatal hernias with the laparoscopic approach might be as high as 11% [15]. Gerull et al. [10] also reported a higher percentage of redo hernias in the robotic group, as well as a lower percentage of esophageal lengthening procedure, such as Collis gastroplasty and wedge fundectomy. Mertens et al. [6] presented a large series of both primary and redo robotic-assisted hiatal hernia repair with major complication rate up to 5.2% and 2.6% respectively, while the incidence of complications of any severity were 17.1% and 10.6%, indicating that the low number of complications in the redo group was not significantly different from the primary procedure group. The presence of strong adhesions and the strangulation of a significant portion of abdominal viscera consist the two main reasons for conversion in the robotic group [6]. Sowards et al. [16] mentioned longer operative times, increased hospital LOS, and the use of mesh in the recurrent group compared to the primary group, with no significant difference in intraoperative complications, estimated blood loss, or postoperative dysphagia, while no conversion was noticed. On the other hand, a single-center retrospective study by Tolboom et al. [13] reported a significant reduction in conversion rates and in hospitalization time in the robotic-assisted redo group, whereas the most common complication was the perforation of the esophagus or the stomach. Nevertheless, previous laparoscopic antireflux surgery does not suggest an indication for open approach in case of recurrence; if a robotic platform is available in combination with an experienced surgical team, a robotic approach is recommended.
Experience from robotic redo hiatal hernia repair after primary robotic procedure is provided by Arcerito et al. [17], who mentioned the increased possibility of conversion to open approach due to the severe scar tissue lying between hiatal crura and fundoplication, which developed more likely from the placement of an absorbable mesh. However, no mesh-related complications are mentioned during a two-and-a-half-year time period [17], thanks to the absorbable property, even in longer follow-up periods [18].
Regarding the learning curve, it is believed that the robotic approach has a shorter learning curve compared to laparoscopy for advanced surgical procedures, while a significant case volume and dedicated operation room staff can significantly reduce the operation time [19]. Galvani et al. [20], in a large cohort of 61 robotic procedures all performed by one surgeon, claimed a learning curve of 36 cases, comparable to conventional laparoscopy. Sarkaria et al. [12] in a series of 24 patients, noticed that the operation time was decreased by 98 minutes between the second and the first half of the series. Washington et al. [21] also reported shorter operative time between the early and the late robotic experience, 184 and 142 minutes respectively, as well as a significant decrease in conversion rates, after only one year of thirteen robotic procedures.
Another topic of interest is the application of the robotic platform in the emergency setting in cases of strangulation of hernia contents. According to a study published by Hosein et al. [22], minimally invasive approaches predominate even in the urgent setting, with better postoperative outcomes, with the open approach being selected only for extremely ill patients. The robotic approach was superior to the open one for mild to moderate ill patients, but not superior to the laparoscopic approach. In another study by Vasudevan et al. [19], 40% of the robotic procedures were performed on patients presenting with acute symptoms and neither higher operative time nor conversions were observed in comparison to elective cases. Arcerito et al. [17] also suggested the robotic approach for the treatment of acutely presented hiatal hernias even on admission day. Equivalent outcomes were noticed even for complete upside-down stomach hiatal hernias [23]. Because of the higher cost, the robotic approach is reserved for giant or revisional hiatal hernias in some centers [22].
Regarding the recurrence rates, there is not enough evidence in the literature concerning the long-term outcomes. Mertens et al. [6] reported two cases of early symptomatic recurrence requiring redo surgery during the 30-day postoperative period. Draaisma et al. [24] reported a low midterm recurrence rate after 1 year of follow-up. Brenkman et al. [25], in a cohort of 40 patients and during an 11-month follow-up period, reported only one symptomatic recurrence (2.5%). He attributed this result to the application of the robotic platform and the Toupet-fundoplication, which attached to the crus, provides further support to the hiatal repair, while no mesh was placed. Galvani et al. [20] in a cohort of 61 patients, where mesh was used in all cases, and during a median follow-up period of 24 months, reported a radiologic recurrence rate up to 42%, pointing out that the majority of the patients were asymptomatic and indicating than the durability of the repair decreases over time. Arcerito et al. [17] also provided promising evidence regarding the long-term recurrence rate during two-and-a-half years of follow-up. In one of the largest studies with paraesophageal hiatal hernia repair by Gerull et al. [11], a radiographic recurrence rate of only 9% during 5 years of observation is reported, in combination with clinically significant quality of life benefits. The presentation of recurrence may not solely depend on the surgical technique but also on the presence of ultrastructural abnormalities in the muscular tissue of the crura in patients with hiatal hernia. These patients often exhibit a high incidence of severe muscular lesions, which are not observed in individuals with a normal gastroesophageal junction [26]. This evidence supports the application of mesh in order to strengthen the hiatal repair and lower the recurrence rates.
Robotic procedures in general are associated with higher costs. Interestingly, Gerull et al. [11] reported that the operation equipment costs were similar between robotic and traditional laparoscopic paraesophageal hernia repair, with a mean difference of only $89. Lekarczyk et al. [27] found similar hospital profits for the robotic group despite higher supply costs and charges. However, Kulshrestha et al. [28], in a study with more participants, reported that both open and robotic-assisted procedures had significantly higher median index hospitalization costs compared to laparoscopic ones. The most common reasons that increased the cost were upper endoscopy and reoperation, followed by emergent priority, increased comorbidity index, and LOS. Hosein et al. [22] also demonstrated that the laparoscopic approach was the least expensive. However, the increased experience of the surgeons with the robotic platform, which will lead to fewer complications, LOS, and postoperative exams, as well as the fact that the cost of the robotic equipment will go down over time, might diminish this difference in the future.
The robotic platform has been used successfully for the repair of other diaphragmatic hernias, such as Morgagni [29,30], Bochdalek [31], and even postesophagectomy hiatal hernias [32], indicating its potential in technically demanding procedures.
Over the last decades, esophageal surgery has evolved from open approaches including both laparotomy and thoracotomy to minimally invasive procedures. The robotic-assisted hiatal hernia repair is superior to the traditional open approach in terms of overall complication rate, mortality [20], postoperative pain, and hospital LOS. However, its superiority over conservative laparoscopy has not been proven yet.
The present meta-analysis did not demonstrate any advantage of the robotic-assisted paraesophageal hernia repair over the conventional laparoscopic approach, which remains the most cost-effective approach. Robotic paraesophageal hernia repair is safe and feasible, but still not superior to laparoscopy, unless in cases with recurrent complex hernias. It is obvious that more comparative and mainly randomized control studies with subgroup analysis need to be performed in order to reach more accurate conclusions and find out which patients would benefit most. A long-term follow-up of the patients is essential because there is a lack of evidence in the literature concerning the recurrence rates of each approach.
Ethical statements
This systematic review and meta-analysis were conducted in accordance with ethical principles and guidelines. As this study is based on literature review, institutional ethics committee approval was not required.
Authors’ contributions
Conceptualization, Investigation, Methodology, Software: SE
Data curation, Validation: GI
Formal analysis: KA
Supervision, Resources: MK
Project administration: KA
Visualization: PP
Writing–original draft: SE
Writing–review & editing: PP
All authors read and approved the final manuscript.
Conflict of interest
All authors have no conflicts of interest to declare.
Funding/support
None.
Data availability
The data presented in this study are available on request from the corresponding author.
Data for postoperative complications
Study | Year | Nation | Study design | Participants (n) | Overall postoperative complications (n) | OR (95% CI) | ||||
---|---|---|---|---|---|---|---|---|---|---|
Laparoscopy | Robotic | Laparoscopy | Robotic | |||||||
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 12 | 2 | 1 | 0.68 (0.05–8.5) | 0.765 | |
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 142 | 29 | 9 | 0.28 (0.13–0.63) | 0.001 | |
Ward et al. [3] | 2021 | United States | Retrospective database analysis | 158,432 | 9,897 | 17,843 | 1,321 | 1.21 (1.14–1.29) | 0.005 | |
Hosein et al. [22] | 2021 | United States | Retrospective database analysis | 6,774 | 835 | 250 | 16 | 0.51 (0.31–0.85) | 0.05 | |
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 55 | 11 | 6 | 0.82 (0.29–2.37) | 0.8 | |
Tjeerdsma et al. [8] | 2022 | United States | Single-center retrospective analysis | 42 | 16 | 15 | 5 | 0.24 (0.08–0.75) | 0.749 |
OR, odds ratio; CI, confidence interval.
Data for the length of stay, the estimated blood loss, and the recurrence rates
Study | Year | Nation | Study design | Participants (n) | Length of stay (day) | Estimated blood loss (mL) | Recurrence rates (%)a) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Laparoscopy | Robotic | Laparoscopy | Robotic | Laparoscopy | Robotic | Laparoscopy | Robotic | ||||||||||
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 12 | 6.5 ± 1.6 (IQR, 5–10) | 7.8 ± 3.9 (IQR, 5–19) | 0.272 | 24 ± 42 (IQR, 0–150) | 33 ± 85 (IQR, 0–300) | 0.742 | ||||||
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 142 | 1.8 ± 1.5 | 1.3 ±1.8 | 0.003 | |||||||||
O'Connor et al. [9] | 2020 | United States | Single-center retrospective analysis | 278 | 114 | 3.3 | 2.3 | 0.003 | 32.8 | 13.3 | 0.008 | ||||||
Gerull et al. [10] | 2021 | United States | Retrospective database analysis | 1,024 | 830 | 2.9 ± 1.4 | 1.8 ± 0.6 | 0.001 | 89.3 ± 27.8 | 27.3 ± 5.9 | 0.001 | ||||||
Hosein et al. [22] | 2021 | United States | Retrospective database analysis | 6,774 | 835 | 3.9 | 3.44 | ||||||||||
Kulshrestha et al. [28] | 2021 | United States | Retrospective database analysis | 5,962 | 1,520 | 2 (IQR, 1–4) | 3 (IQR, 2–5) | 0.001 | |||||||||
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 55 | 4 (3.8–4.2) | 3.6 (3.4–3.8) | 0.2 | 44.2 | 57.2 | 0.25 | ||||||
Lekarczyk et al. [27] | 2023 | United States | Single-center retrospective analysis | 42 | 31 | 2.55 | 2 | 0.09 | |||||||||
Tjeerdsma et al. [8] | 2022 | United States | Single-center retrospective analysis | 42 | 16 | 2.5 (1–4) | 3 (2–5.75) | 0.301 |
IQR, interquartile range.
a)One-year follow-up.
Data for operation time
Study | Year | Nation | Study design | Laparoscopic (n) | Operation time (min) | Robotic (n) | Operation time (min) | |
---|---|---|---|---|---|---|---|---|
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 168 ± 42 (IQR, 130–290) | 12 | 172 ± 31 (IQR, 115–120) | 0.785 |
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 158 (IQR, 132–188) | 142 | 186.5 (IQR, 152–232) | 0.001 |
O'Connor et al. [9] | 2020 | United States | Single-center retrospective study | 278 | 175 | 114 | 179 | 0.681 |
Gerull et al. [10] | 2021 | United States | Retrospective database review | 1,024 | 187.3 ± 65.3 | 830 | 174.1 ± 63.8 | 0.001 |
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 125 ± 35.5 | 55 | 149 ± 42.1 | 0.01 |
Lekarczyk et al. [27] | 2023 | United States | Single-center retrospective analysis | 42 | 256.7 | 31 | 257.6 | 0.48 |
IQR, interquartile range.
Table 1 . Data for postoperative complications.
Study | Year | Nation | Study design | Participants (n) | Overall postoperative complications (n) | OR (95% CI) | ||||
---|---|---|---|---|---|---|---|---|---|---|
Laparoscopy | Robotic | Laparoscopy | Robotic | |||||||
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 12 | 2 | 1 | 0.68 (0.05–8.5) | 0.765 | |
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 142 | 29 | 9 | 0.28 (0.13–0.63) | 0.001 | |
Ward et al. [3] | 2021 | United States | Retrospective database analysis | 158,432 | 9,897 | 17,843 | 1,321 | 1.21 (1.14–1.29) | 0.005 | |
Hosein et al. [22] | 2021 | United States | Retrospective database analysis | 6,774 | 835 | 250 | 16 | 0.51 (0.31–0.85) | 0.05 | |
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 55 | 11 | 6 | 0.82 (0.29–2.37) | 0.8 | |
Tjeerdsma et al. [8] | 2022 | United States | Single-center retrospective analysis | 42 | 16 | 15 | 5 | 0.24 (0.08–0.75) | 0.749 |
OR, odds ratio; CI, confidence interval..
Table 2 . Data for the length of stay, the estimated blood loss, and the recurrence rates.
Study | Year | Nation | Study design | Participants (n) | Length of stay (day) | Estimated blood loss (mL) | Recurrence rates (%)a) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Laparoscopy | Robotic | Laparoscopy | Robotic | Laparoscopy | Robotic | Laparoscopy | Robotic | ||||||||||
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 12 | 6.5 ± 1.6 (IQR, 5–10) | 7.8 ± 3.9 (IQR, 5–19) | 0.272 | 24 ± 42 (IQR, 0–150) | 33 ± 85 (IQR, 0–300) | 0.742 | ||||||
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 142 | 1.8 ± 1.5 | 1.3 ±1.8 | 0.003 | |||||||||
O'Connor et al. [9] | 2020 | United States | Single-center retrospective analysis | 278 | 114 | 3.3 | 2.3 | 0.003 | 32.8 | 13.3 | 0.008 | ||||||
Gerull et al. [10] | 2021 | United States | Retrospective database analysis | 1,024 | 830 | 2.9 ± 1.4 | 1.8 ± 0.6 | 0.001 | 89.3 ± 27.8 | 27.3 ± 5.9 | 0.001 | ||||||
Hosein et al. [22] | 2021 | United States | Retrospective database analysis | 6,774 | 835 | 3.9 | 3.44 | ||||||||||
Kulshrestha et al. [28] | 2021 | United States | Retrospective database analysis | 5,962 | 1,520 | 2 (IQR, 1–4) | 3 (IQR, 2–5) | 0.001 | |||||||||
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 55 | 4 (3.8–4.2) | 3.6 (3.4–3.8) | 0.2 | 44.2 | 57.2 | 0.25 | ||||||
Lekarczyk et al. [27] | 2023 | United States | Single-center retrospective analysis | 42 | 31 | 2.55 | 2 | 0.09 | |||||||||
Tjeerdsma et al. [8] | 2022 | United States | Single-center retrospective analysis | 42 | 16 | 2.5 (1–4) | 3 (2–5.75) | 0.301 |
IQR, interquartile range..
a)One-year follow-up..
Table 3 . Data for operation time.
Study | Year | Nation | Study design | Laparoscopic (n) | Operation time (min) | Robotic (n) | Operation time (min) | |
---|---|---|---|---|---|---|---|---|
Gehrig et al. [7] | 2013 | Germany | Single-center retrospective analysis | 17 | 168 ± 42 (IQR, 130–290) | 12 | 172 ± 31 (IQR, 115–120) | 0.785 |
Soliman et al. [4] | 2020 | United States | Single-center retrospective analysis | 151 | 158 (IQR, 132–188) | 142 | 186.5 (IQR, 152–232) | 0.001 |
O'Connor et al. [9] | 2020 | United States | Single-center retrospective study | 278 | 175 | 114 | 179 | 0.681 |
Gerull et al. [10] | 2021 | United States | Retrospective database review | 1,024 | 187.3 ± 65.3 | 830 | 174.1 ± 63.8 | 0.001 |
Benedix et al. [5] | 2021 | Germany | Single-center retrospective analysis | 85 | 125 ± 35.5 | 55 | 149 ± 42.1 | 0.01 |
Lekarczyk et al. [27] | 2023 | United States | Single-center retrospective analysis | 42 | 256.7 | 31 | 257.6 | 0.48 |
IQR, interquartile range..
Jae Young Jang, Eui Hyuk Chong, Incheon Kang, Seok Jeon Yang, Sung Hwan Lee, Sung Hoon Choi
Journal of Minimally Invasive Surgery 2023; 26(2): 72-82Sa-Hong Min, M.D., Yo-Seok Cho, M.D., Kibum Park, M.D., Ph.D., Yoontaek Lee, M.D., Young Suk Park, M.D., Sang-Hoon Ahn, M.D., Do Joong Park, M.D., Ph.D., Hyung-Ho Kim, M.D., Ph.D.
Journal of Minimally Invasive Surgery 2019; 22(4): 157-163Seong Hyun Lee, M.D., Beom Su Kim, M.D., Youn Baik Choi, M.D.
J Minim Invasive Surg 2010; 13(1): 26-30