To demonstrate the effectiveness of DualVD, we propose two novel visual dialogue models by applying it to the Late Fusion framework and Memory Network framework. The proposed models achieve state-of-the-art results on three benchmark datasets. A critical advantage of the DualVD module lies in its interpretability. We can analyze which modality (visual or semantic) has more contribution in answering the current question by explicitly visualizing the gate values. It gives us insights in understanding of information selection mode in the Visual Dialogue task. https://www.selleckchem.com/products/Adriamycin.html The code is available at https//github.com/JXZe/Learning_DualVD.Vehicles, pedestrians, and riders are the most important and interesting objects for the perception modules of self-driving vehicles and video surveillance. However, the state-of-the-art performance of detecting such important objects (esp. small objects) is far from satisfying the demand of practical systems. Large-scale, rich-diversity, and high-resolution datasets play an important role in developing better object detection methods to satisfy the demand. Existing public large-scale datasets such as MS COCO collected from websites do not focus on the specific scenarios. Moreover, the popular datasets (e.g., KITTI and Citypersons) collected from the specific scenarios are limited in the number of images and instances, the resolution, and the diversity. To attempt to solve the problem, we build a diverse high-resolution dataset (called TJU-DHD). The dataset contains 115354 high-resolution images (52% images have a resolution of 1624×1200 pixels and 48% images have a resolution of at least 2, 560×1.440 pixels) and 709 330 labeled objects in total with a large variance in scale and appearance. Meanwhile, the dataset has a rich diversity in season variance, illumination variance, and weather variance. In addition, a new diverse pedestrian dataset is further built. With the four different detectors (i.e., the one-stage RetinaNet, anchor-free FCOS, two-stage FPN, and Cascade R-CNN), experiments about object detection and pedestrian detection are conducted. We hope that the newly built dataset can help promote the research on object detection and pedestrian detection in these two scenes. The dataset is available at https//github.com/tjubiit/TJU-DHD.In this paper, we propose an effective approach to infer the just noticeable distortion (JND) profile based on patch-level structural visibility learning. Instead of pixel-level JND profile estimation, the image patch, which is regarded as the basic processing unit to better correlate with the human perception, can be further decomposed into three conceptually independent components for visibility estimation. In particular, to incorporate the structural degradation into the patch-level JND model, a deep learning-based structural degradation estimation model is trained to approximate the masking of structural visibility. In order to facilitate the learning process, a JND dataset is further established, including 202 pristine images and 7878 distorted images generated by advanced compression algorithms based on the upcoming Versatile Video Coding (VVC) standard. Extensive experimental results further show the superiority of the proposed approach over the state-of-the-art. Our dataset is available at https//github.com/ShenXuelin-CityU/PWJNDInfer.There are two main issues in RGB-D salient object detection (1) how to effectively integrate the complementarity from the cross-modal RGB-D data; (2) how to prevent the contamination effect from the unreliable depth map. In fact, these two problems are linked and intertwined, but the previous methods tend to focus only on the first problem and ignore the consideration of depth map quality, which may yield the model fall into the sub-optimal state. In this paper, we address these two issues in a holistic model synergistically, and propose a novel network named DPANet to explicitly model the potentiality of the depth map and effectively integrate the cross-modal complementarity. By introducing the depth potentiality perception, the network can perceive the potentiality of depth information in a learning-based manner, and guide the fusion process of two modal data to prevent the contamination occurred. The gated multi-modality attention module in the fusion process exploits the attention mechanism with a gate controller to capture long-range dependencies from a cross-modal perspective. Experimental results compared with 16 state-of-the-art methods on 8 datasets demonstrate the validity of the proposed approach both quantitatively and qualitatively.Passive cavitation mapping (PCM) techniques typically utilize a time-exposure acoustic (TEA) approach, where the received radio frequency data are beamformed, squared, and integrated over time. Such PCM-TEA cavitation maps typically suffer from long-tail artifacts and poor axial resolution with pulse-echo diagnostic arrays. Here, we utilize a recently developed PCM technique based on cavitation source localization (CSL), which fits a hyperbolic function to the received cavitation wavefront. A filtering method based on the root-mean-square error (rmse) of the hyperbolic fit is utilized to filter out spurious signals. We apply a wavefront correction technique to the signals with poor fit quality to recover additional cavitation signals and improve cavitation localization. Validation of the PCM-CSL technique with rmse filtering and wavefront correction was conducted in experiments with a tissue-mimicking flow phantom and an in vivo mouse model of cancer. It is shown that the quality of the hyperbolic fit, necessary for the PCM-CSL, requires an rmse less then 0.05 mm2 in order to accurately localize the cavitation sources. A detailed study of the wavefront correction technique was carried out, and it was shown that, when applied to experiments with high noise and interference from multiple cavitating microbubbles, it was capable of effectively correcting noisy wavefronts without introducing spurious cavitation sources, thereby improving the quality of the PCM-CSL images. In phantom experiments, the PCM-CSL was capable of precisely localizing sources on the therapy beam axis and off-axis sources. In vivo cavitation experiments showed that PMC-CSL showed a significant improvement over PCM-TEA and yielded acceptable localization of cavitation signals in ****.
To demonstrate the effectiveness of DualVD, we propose two novel visual dialogue models by applying it to the Late Fusion framework and Memory Network framework. The proposed models achieve state-of-the-art results on three benchmark datasets. A critical advantage of the DualVD module lies in its interpretability. We can analyze which modality (visual or semantic) has more contribution in answering the current question by explicitly visualizing the gate values. It gives us insights in understanding of information selection mode in the Visual Dialogue task. https://www.selleckchem.com/products/Adriamycin.html The code is available at https//github.com/JXZe/Learning_DualVD.Vehicles, pedestrians, and riders are the most important and interesting objects for the perception modules of self-driving vehicles and video surveillance. However, the state-of-the-art performance of detecting such important objects (esp. small objects) is far from satisfying the demand of practical systems. Large-scale, rich-diversity, and high-resolution datasets play an important role in developing better object detection methods to satisfy the demand. Existing public large-scale datasets such as MS COCO collected from websites do not focus on the specific scenarios. Moreover, the popular datasets (e.g., KITTI and Citypersons) collected from the specific scenarios are limited in the number of images and instances, the resolution, and the diversity. To attempt to solve the problem, we build a diverse high-resolution dataset (called TJU-DHD). The dataset contains 115354 high-resolution images (52% images have a resolution of 1624×1200 pixels and 48% images have a resolution of at least 2, 560×1.440 pixels) and 709 330 labeled objects in total with a large variance in scale and appearance. Meanwhile, the dataset has a rich diversity in season variance, illumination variance, and weather variance. In addition, a new diverse pedestrian dataset is further built. With the four different detectors (i.e., the one-stage RetinaNet, anchor-free FCOS, two-stage FPN, and Cascade R-CNN), experiments about object detection and pedestrian detection are conducted. We hope that the newly built dataset can help promote the research on object detection and pedestrian detection in these two scenes. The dataset is available at https//github.com/tjubiit/TJU-DHD.In this paper, we propose an effective approach to infer the just noticeable distortion (JND) profile based on patch-level structural visibility learning. Instead of pixel-level JND profile estimation, the image patch, which is regarded as the basic processing unit to better correlate with the human perception, can be further decomposed into three conceptually independent components for visibility estimation. In particular, to incorporate the structural degradation into the patch-level JND model, a deep learning-based structural degradation estimation model is trained to approximate the masking of structural visibility. In order to facilitate the learning process, a JND dataset is further established, including 202 pristine images and 7878 distorted images generated by advanced compression algorithms based on the upcoming Versatile Video Coding (VVC) standard. Extensive experimental results further show the superiority of the proposed approach over the state-of-the-art. Our dataset is available at https//github.com/ShenXuelin-CityU/PWJNDInfer.There are two main issues in RGB-D salient object detection (1) how to effectively integrate the complementarity from the cross-modal RGB-D data; (2) how to prevent the contamination effect from the unreliable depth map. In fact, these two problems are linked and intertwined, but the previous methods tend to focus only on the first problem and ignore the consideration of depth map quality, which may yield the model fall into the sub-optimal state. In this paper, we address these two issues in a holistic model synergistically, and propose a novel network named DPANet to explicitly model the potentiality of the depth map and effectively integrate the cross-modal complementarity. By introducing the depth potentiality perception, the network can perceive the potentiality of depth information in a learning-based manner, and guide the fusion process of two modal data to prevent the contamination occurred. The gated multi-modality attention module in the fusion process exploits the attention mechanism with a gate controller to capture long-range dependencies from a cross-modal perspective. Experimental results compared with 16 state-of-the-art methods on 8 datasets demonstrate the validity of the proposed approach both quantitatively and qualitatively.Passive cavitation mapping (PCM) techniques typically utilize a time-exposure acoustic (TEA) approach, where the received radio frequency data are beamformed, squared, and integrated over time. Such PCM-TEA cavitation maps typically suffer from long-tail artifacts and poor axial resolution with pulse-echo diagnostic arrays. Here, we utilize a recently developed PCM technique based on cavitation source localization (CSL), which fits a hyperbolic function to the received cavitation wavefront. A filtering method based on the root-mean-square error (rmse) of the hyperbolic fit is utilized to filter out spurious signals. We apply a wavefront correction technique to the signals with poor fit quality to recover additional cavitation signals and improve cavitation localization. Validation of the PCM-CSL technique with rmse filtering and wavefront correction was conducted in experiments with a tissue-mimicking flow phantom and an in vivo mouse model of cancer. It is shown that the quality of the hyperbolic fit, necessary for the PCM-CSL, requires an rmse less then 0.05 mm2 in order to accurately localize the cavitation sources. A detailed study of the wavefront correction technique was carried out, and it was shown that, when applied to experiments with high noise and interference from multiple cavitating microbubbles, it was capable of effectively correcting noisy wavefronts without introducing spurious cavitation sources, thereby improving the quality of the PCM-CSL images. In phantom experiments, the PCM-CSL was capable of precisely localizing sources on the therapy beam axis and off-axis sources. In vivo cavitation experiments showed that PMC-CSL showed a significant improvement over PCM-TEA and yielded acceptable localization of cavitation signals in mice.
0 Commentarios
0 Acciones
16 Views
0 Vista previa
