Transfer Learning for Human & AI

Evaluation in natural language processing guides and promotes research on models and methods . In recent years, new evalua-tion data sets and evaluation tasks have been continuously proposed . A series of problemsexposed by ex-existing evaluation have also restricted the progress of naturallanguage processing technology .…

Given two relations containing multiple measurements – possibly withuncertainties – our objective is to find which sets of attributes from the first have a corresponding set on the second, using exclusively a sample of the data . This approach could be used even when the associated metadata is damaged, missing or incomplete, or when the volume is too big for exact methods .…

Neural Machine Translation (NMT) has achieved significant breakthrough in performance but is known to suffer vulnerability to input perturbations . Asreal input noise is difficult to predict during training, robustness is a big issue for system deployment . In this paper, we improve the robustness of NMT models by reducing the effect of noisy words through a Context-EnhancedReconstruction (CER) approach .…

Internet of Things (IoT) is transforming human lives by paving the way for the management of physical devices on the edge . Intrusion detection methods are commonly used for the detection of such kinds of attacks but with these methods, the performance/accuracy is not optimal .…

Synthetically produced data containing fabricated or merged network traffic is of limitedvalue as it is easily distinguishable from real traffic by even simple machinelearning (ML) algorithms . Real-world malware is defanged and introduced to simulated, secured nodes within those networks to generate realistic traffic while maintaining sufficient isolation to protect real data and infrastructure .…

Deep Neural Networks (DNNs) report state-of-the-art results in many machine learning areas, including intrusion detection . Recent studies in computer vision have shown that DNNs can be vulnerable toadversarial attacks that are capable of deceiving them into misclassification by injecting specially crafted data .…

Principal component analysis (PCA) is a classic technique for extracting the linear structure of a dataset . The novelty of this design lies in exploiting channel noise to accelerate the descent in the region around each saddle point encountered by gradient descent, thereby increasing the convergence speed of over-the-air PCA .…

We provide an approximation algorithm for k-means clustering in the one-round(aka non-interactive) local model of differential privacy (DP) This algorithmachieves an approximation ratio arbitrarily close to the best non-approximation algorithm, improving upon previously known algorithms that only guarantee large (constant) approximation ratios .…

The core of personalized news recommendation is accurate matching betweencandidate news and user interest . Most existing news recommendation methods usually model candidate news from its textual content . However, a news article may cover multiple aspects and entities, and a user may have multiple interests .…

Cybercriminals are rapidly developing new malicious tools that leverage AI to enable new classes of adaptive and stealthy attacks . New defensive methods need to be developed to counter these threats . Alan Turing Institute, with expert guidance from UK Cyber Security Centre and Defence Science Technology Laboratory, published a research roadmap for AI for ACD last year .…

Diabetes affects over 400 million people and is among the leading causes ofmorbidity worldwide . Identification of high-risk individuals can support earlydiagnosis and prevention of disease development through lifestyle changes . However, existing risk scores require information about blood-based factors which are not obtainable outside of the clinic .…

We present BIEBER (Byte-IdEntical Binary parsER), the first system to modeland regenerate a working parser from instrumented program executions . Toachieve this, BIEber exploits the regularity (e.g., header fields andarray-like data structures) that is commonly found in file formats . Separate backends (C and Perl in our prototype) can translate the IR intothe same language as the original program (for a safer drop-in replacement), or port to a different language .…

Semi-online algorithms that are allowed to perform a bounded amount of repacking achieve guaranteed good worst-case behaviour in a more realisticsetting . We present a framework for choosing problems that allows usto transfer offline algorithms into $(\alpha-epsilon) algorithms with amortized migration$O(1/\epSilon) We complement these positive results with lower bounds with lowerbounds that show that our results are tight in the sense that no amortization of $o(1)$ is possible .…

We study an optimization problem that aims to determine the shape of anobstacle that is submerged in a fluid governed by the Stokes equations . The mentioned flow takes place in a channel, which motivated the imposition of aPoiseuille-like input function on one end and a do-nothing boundary condition on the other .…

In the literature on parameterized graph problems, there has been an increased effort in recent years aimed at exploring novel notions of graphedit-distance that are more powerful than the size of a modulator to a specificgraph class . In this paper, we show that deciding whether a given graph has elimination distance at most $k$ to any minor-closed class ofgraphs is fixed-parameter tractable .…

The aim of this work is to present a brief report concerning the various aspects of the Reduced Basis Method within Fluid-Structure Interaction problems . The toy problem that we consider is the Turek-Hron benchmark testcase, with a fluid Reynolds number Re = 100, which is known to lead to the formation of Karman vortexes in the fluid, and a periodically oscillatingbehaviour in the structure .…

PROP has reached new SOTA on a variety of ad-hoc retrieval benchmarks . The PROP method is bootstrapped based on BERT for information retrieval . The key idea is to use the powerful contextual language modelBERT to replace the classical unigram language model for the ROP task construction, and re-train BERT itself towards the tailored objective for IR .…

Grytczuk conjecture that for any sequence of alphabet of size $3$ there exists a square-free infinite word $w$ such that the $i$-th letter of the letter of $W$ belongs to $\ell_i$ The result of Thueof 1906 implies that there is an infinite square free word if all the letters of the alphabet are identical .…

Referring expression comprehension aims to localize objects identified by natural language descriptions . Eachobject can be described by synonymous sentences with paraphrases, and suchvarieties in languages have critical impact on learning a comprehension model . We develop an end-to-end trainable framework to learn contrastive features on the image andobject instance levels .…

We present a self-improving, neural tree expansion method for multi-robotonline planning in non-cooperative environments . Our algorithm adapts the centralized, perfect information,discrete-action space method from Alpha Zero to a decentralized, partial information, continuous action space setting . Our numerical experiments demonstrate neural expansion generatescompact search trees with better solution quality and 20 times less computing expense compared to MCTS without neural expansion .…

A walking harvester performs the challenging task of autonomous navigation and tree grabbing in a confined, GPS denied forestenvironment . Strategies for mapping, localization, planning, and control are proposed and integrated into a fully autonomous system . The mission starts with a human or a mobile robot mapping the area of interest using a custom-madesensor module .…

Password managers help users more effectively manage their passwords, encouraging them to adopt stronger passwords across their many accounts . Mobile operating systems provide autofill frameworks that are designed to integrate with password managers . They also enforce insecure behavior and fail toprovide the password managers implemented using the frameworks with sufficient information to override this incorrect behavior .…

A multi-modal-based online learning system for 3DLiDAR-based object classification in urban environments, including cars, cyclists and pedestrians . The proposed system aims to effectively transfer detection capabilities based on visual sensors to the new model learningbased on non-visual sensors through a multi-target tracker (i.e.…

This work shows that, for extrapolations based on finitetransformation groups, a model’s inability to extrapolate is unrelated to its capacity . Rather, the shortcoming is inherited from a learning hypothesis: Examples not explicitly observed with infinitely many training examples haveunderspecified outcomes in the learner’s model .…

We investigate the solution landscapes of the Onsager free-energy functional with different potential kernels . For the coupled dipolar/Maier–Saupe potential, the solutionlandscape shows a novel non-axisymmetric critical point, named as tennis, whichexists for a wide range of parameters . The solution landscape provides an efficient approach to show the global structures as well as the bifurcations of critical points, which can not only verify the previous analytic results but also proposes conjectures based on the numerical findings .…

This paper focuses on an online version of the emerging distributedconstrained aggregative optimization framework . Agents in a network want tominimize the sum of local cost functions, each one depending both on a localoptimization variable, subject to a local constraint, and on an aggregatedversion of all the variables (e.g.,…

In this short contribution we introduce a new procedure to recover the stressand strain fields for particle systems by mechanical models . Numerical tests for simple loading conditions have shown an excellent match between theestimated values and the reference values .…

This paper proposes a framework to investigate the value of sharingprivacy-protected smart meter data between domestic consumers and load servingentities . The framework consists of a discounted differential privacy model toensure individuals cannot be identified from aggregated data . It also includes a ANN-basedshort-term load forecasting to quantify the impact of data availability and privacy protection on the forecasting error and an optimal procurement day-ahead and balancing markets to assess the market value of the privacy-utility trade-off .…

Convolutional neural networks learn to extract representations of complex features such as object shapes and textures to solve image recognition tasks . Recent work indicates CNNs trained on ImageNet are biased towardsfeatures that encode textures . These alone are sufficient to generalizeto unseen test data from the same distribution as the training data but often fail to generalize to out-of-distribution data .…

Flow-based encoder-decodernetwork (FUNet) combines traditional Horn-Schunck optical-flowestimation technique and convolutional neural networks to perform robustreal-time video segmentation . Code and pre-trained models are available on GitHub repository:\url{https://://://www.g.com/kuangzijian/Flow-Based-based-Video-Matting.net . We also introduce a video and image segmentationdataset: ConferenceVideoSegmentationDataset .…

The proposed algorithm is based on thelinear-in-the-parameters (LIP) nonlinear filters and their implementation asfunctional link adaptive filters (FLAFs) We focus here on a new effective and efficient approach for FLAFs based on frequency-domain adaptive filters . We propose a partitioned block approach for their implementation .…

In this study, we devise a model that introduces two hierarchies intoinformation entropy . The size of the region for whichentropy is calculated and the component that determines whether thestructures in the image are integrated or not . Both indicators increase or decrease due to the integration or fragmentation of the structure in an image .…

The recently emerged symbol-level precoding (SLP) technique has been regarded as a promising solution in multi-user wireless communication systems . However, the tremendous computational complexity of conventional SLP designs severely hinders the practical implementation of the technique . The proposed EPNN based SLP design candramatically reduce the computing time at the price of slight performance loss .…

Wicked problems reflect our incomplete understanding of interdependent global systems and the hyper-risk they pose . Such problems escape solutions because they are often ill-defined and thus mis-identified andunder-appreciated by problem-solvers and the communities they constitute . We develop a quantitative framework for understanding the class of wicked problems that emerge at the intersections of natural, social, and technological complex systems .…

Conventional video recognition pipelinestypically fuse multimodal features for improved performance . But this is not only computationally expensive but also neglects the fact that differentvideos rely on different modalities for predictions . HMS operates on a low-costmodality, i.e., audio clues, by default, and dynamically decides on-the-fly whether to use computationally-expensive modalities on a per-input basis .…

Weakly Supervisedphrase-Grounding (WSG) deals with the task of using this data to learn to localize (or to ground) arbitrary text phrases in images without any additionalannotations . Most recent SotA methods for WSG assume the existence of a pre-trained object detector, relying on it to produce the ROIs for localization .…

The Slepian-Wolf bound on the admissible coding rate forms the most fundamental aspect of distributed source coding . It is necessary to model more practical scenarios with respect to the arrangement of nodes . This paper provides two practical scenarios in order to achieve this aim .…

The use of crowdworkers in NLP research is growing rapidly, in tandem with the exponential increase in research production in machine learning and AI . We find that the Final Rule, the common ethicalframework used by researchers, did not anticipate the use of onlinecrowdsourcing platforms for data collection .…

Speechsynthesis technology helps users get the output of intelligent machine more easily and intuitively . Current research focus is the deep learning-basedend-to-end speech synthesis technology . It mainly consists of three modules: textfront-end, acoustic model, and vocoder . This paper reviews the research status of these three parts, and classifies and compares various methods according to their emphasis .…

This paper describes our contribution to the WASSA 2021 shared task on Emotion Prediction and Emotion Classification . The broad goal of this task was to model an empathy score, a distress score and the overall level of emotion of an essay written in response to a newspaper article associated with harm to someone .…

This paper targets the problem of procedural multimodal machine comprehension(M3C) This task requires an AI to comprehend given steps of multimodalinstructions and then answer questions . Yagcioglu etal. [35] introduced RecipeQA dataset to evaluate M3C . We hypothesized that naturally occurring bias present in the dataset affects even the bestperforming model .…

DeepHunter is a graph neural network (GNN)based graph pattern matching approach that can match provenance data against known attack behaviors in a robust way . The accuracy and robustness of DeepHunter outperform the state-of-the-art method, Poirot, authors say . DeepHunter can hunt all attack behaviors, and the accuracy of the method outperforms the state of the art method, poirot .…

Spatial Contextual Module (SCM) leveraged to learn spatial contextual dependency between pixels by exploring thecorrelation between pixels and categories . The Channel ContextualModule (CCM) is introduced to learn the semantic features including thesemantic feature maps and class-specific features . The learned semantic features are used as the prior knowledge to guide the learning of SCM, which can makeSCM obtain more accurate long-range spatial dependency .…

Machine learning has proved to be a useful tool for extracting knowledge from scientific data in numerous research fields . Dislib’s main distributed data structure, called Dataset, has some limitations, including poor performance in certain operations and low flexibility andusability .…

In this work, we create a web application to highlight the output of NLP models trained to parse and label discourse segments in law text . Our system is built primarily with journalists and legal interpreters in mind, and we focus on state-level law that uses U.S.…

Arlequin coupling coefficient is essential for concurrent FE-MD models with overlapping domains . Procedure includes steps of determining the relative positions of atoms inside the FE elements in the coupling region . Two approaches are provided for determining thecoefficient: the direct approach and the temperature approach .…

We study a variant of Set Cover where each element of the universe has somedemand that determines how many times the element needs to be covered . We prove that all three problems are fixed-parameter tractable with respect to the combinedparameter budget, the maximum number of elements missing in one of the sets, and how many sets can be included multiple times .…

The widespread dissemination of forged images generated by Deepfaketechniques has posed a serious threat to the trustworthiness of digitalinformation . Most existing approaches combat Deepfakes with deep neural networks by mapping the input image to a binary prediction without capturing the consistency among different pixels .…

Multilevel coding (MLC) is a coded modulation technique which can achieve excellent performance over a range of communication channels . Polar codes have been shown to be quite compatible with communication systems using MLC, as therate allocation of the component polar codes follows the natural polarizationinherent in polar codes .…

An iterative robust minimum mean-squareerror (RMMSE) precoder based on generalized loading is developed to mitigate interference in the presence of imperfect channel state information (CSI) Anachievable rate analysis is carried out and optimal and uniform powerallocation schemes are developed based on the signal-to-interference-plus-noiseratio .…