José Antonio Oramas Mogrovejo tenure track asst. professor

Research José Antonio Oramas Mogrovejo

Research team

Expertise

Research interest: - Visual Representation Learning. - Model Explanation and Interpretation. - Collective Representations and Relational Learning. - Disentangled Representation Learning.

Antwerp Text Mining Centre (TEXTUA). 01/01/2022 - 31/12/2026

Abstract

Most knowledge is stored in unstructured data like text, which must be structured before it can be mined. The need and opportunities for this automatic text analysis have considerably increased recently with developments in Artificial Intelligence, not only in the humanities and social sciences, but also in the exact and medical sciences. The mission of the ATMC is to provide scalable solutions to researchers from any scientific discipline that wants to analyze and use large amounts of textual data. Text data should be seen here in a broad sense including automatically transcribed speech, written text in images, and images automatically described in text. ATMC bundles the unique existing expertise in digital text analysis at the University of Antwerp with special emphasis on explainable AI and will provide the capacity to support the growing number of interdisciplinary queries that reach us today.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

BIM on BUILDING site 01/01/2022 - 31/12/2023

Abstract

Building Information Modeling (BIM) provides insight into the design and planning of a building. However, the benefits of this digital display are not yet fully exploited at the construction site. Schedule updates today are often still done manually and are prone to errors, leading to errors, delays and cost overruns. BoB solves these problems by linking BIM to real-time progress and activity data on the construction site. BoB will use AI-driven technology to detect collective activities (e.g. pouring concrete, formwork, digging) and automatically link the current state of the building from image data to the BIM design. This gives site stakeholders much-needed visibility into actual progress, reduces cost overruns, increases efficiency, prevents errors and reduces construction waste. The connected data platform designed in BoB will be a stepping stone to a fully connected digitized construction site.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

IMEC-Super Bio-Accelerated Mineral weathering (BAM): a new climate risk hedging reactor technology (BAM). 01/09/2021 - 31/08/2025

Abstract

Conventional climate change mitigation alone will not be able to stabilise atmospheric CO2 concentrations at a level compatible with the 2°C warming limit of the Paris Agreement. Safe and scalable negative emission technologies (NETs), which actively remove CO2 from the atmosphere and ensure long-term carbon (C) sequestration, will be needed. Fast progress in NET-development is needed, if NETs are to serve as a risk-hedging mechanism for unexpected geopolitical events and for the transgression of tipping points in the Earth system. Still, no NETs are even on the verge of achieving a substantial contribution to the climate crisis in a sustainable, energy-efficient and cost-effective manner. BAM! develops 'super bio-accelerated mineral weathering' (BAM) as a radical, innovative solution to the NET challenge. While enhanced silicate weathering (ESW) was put forward as a potential NET earlier, we argue that current research focus on either 1/ ex natura carbonation or 2/ slow in natura ecosystem-based ESW, hampers the potential of the technology to provide a substantial contribution to negative emissions within the next two decades. BAM! focuses on an unparalleled reactor effort to maximize biotic weathering stimulation at low resource inputs, and implementation of an automated, rapidlearning process that allows to fast-adopt and improve on critical weathering rate breakthroughs. The direct transformational impact of BAM! lies in its ambition to develop a NET that serves as a climate risk hedging tool on the short term (within 10-20 years). BAM! builds on the natural powers that have triggered dramatic changes in the Earth's weathering environment, embedding them into a novel, reactor-based technology. The ambitious end-result is the development of an indispensable environmental remediation solution, that transforms large industrial CO2 emitters into no-net CO2 emitters.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

IDLab - Internet and Data Lab 01/01/2021 - 31/12/2026

Abstract

The IOF consortium IDLab is composed of academic supervisors at the IDLab Research Group, a UAntwerp research group with members from the Faculty of Science and the Faculty of Applied Engineering. IDLab develops innovative digital solutions in the area of two main research lines: (1) Internet technologies, focusing on wireless networking and Internet of Things (IoT), and (2) Data science, focussing on distributed intelligence and Artificial Intelligence (AI). The mission of the IDLab consortium is to be the number one research and innovation partner in Flanders and leading partner worldwide, in the above research areas, especially applied in a city and its metropolitan surroundings (industry, ports & roads). To realize its mission, IDLab looks at integrated solutions from an application and technology perspective. From an application point of view, we explicitly provide solutions for all stakeholders in metropolitan areas aiming to cross-fertilize these applications. From a technological point of view, our research includes hardware prototyping, connectivity and AI, enabling us to provide a complete integrated solution to our industrial partners from sensor to software. Over the past years, IDLab has been connecting the city and its surroundings with sensors and actuators. It is time to (1) reliably and efficiently connect the data in an integrated way to (2) turn them into knowledgeable insights and intelligent actions. This perfectly matches with our two main research lines that we want to extensively valorise the upcoming years. The IDLab consortium has a unique position in the Flemish eco-system to realize this mission as it is strategically placed across different research and innovation stakeholders: (1) IDLab is a research group embedded in the Strategic Research Centre imec, a leading research institute in the domain of nano-electronics, and more recently through groups such as IDLab, in the domain of digital technology. (2) IDLab has a strategic link with IDLab Ghent, a research group at Ghent University. While each group has its own research activities, we define a common strategy and for the Flemish ecosystem, we are perceived as the leading partner in the research we are performing. (3) IDLab is the co-founder of The Beacon, an Antwerp-based eco-system on innovation where start-ups, scale ups, etc. that work on IoT and AI solutions for the city, logistics, mobility and industry 4.0 come together. (4) Within the valorisation at UAntwerp, IDLab contributes to the valorisation within the domain 'Metropolitanism, Smart City and Mobility'. To realize our valorisation targets, IDLab will define four valorisation programs: VP1: Emerging technologies for next-generation IoT; VP2: Human-like artificial Intelligence; VP3: Learning at the edge; VP4: Deterministic communication networks. Each of these valorisation programs is led by one of the (co-)promoters of the IDLab consortium, and every program is composed of two or three innovation lines. This way, the IDLab research will be translated into a clear program offer towards our (industrial) partners, allowing us to build a tailored offer. Each valorisation program will contribute to the different IOF objectives, but in a differentiated manner. Based on our current experience, some valorisation programs are focusing more on local partners, while others are mainly targeting international and EU funded research projects.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Learning-based representations for the automation of hyperspectral microscopic imaging and predictive maintenance. 01/09/2020 - 31/08/2024

Abstract

In this project we will focus on designing a model for representation learning that will enable the detection of pollution in microscopic samples at the earliest time possible from hyperspectral images (HSI). Current methods for this task operate of on top of RGB images derived from HSIs. Taking this into account we will focus our efforts on designing a method capable of analyzing the full raw data cube that composes each HSI sample and identifying potential signals to enable the accurate detection of pollution in the sample. In addition, as industrial customers become increasingly aware of the growing maintenance costs and downtime caused by the unexpected machinery failures, predictive maintenance solutions for biopharma companies gain more interest to maintain a competitive advantage. To address this issue, we will investigate methods to analyze data traces coming from different sources, e.g. computer logs, operator reports, quality of the collected samples, etc., in order to identify temporal patterns that can serve as strong indicators of a potential anomaly that will occur in the near future on the monitored systems. Finally, for both of the tasks mentioned above, model explanation algorithms will be investigated and designed so that the predictions made by their respective models can be justified. Moreover, these explanation algorithms, will serve to debug the trained models and assess their validity and robustness towards artifacts, e.g. biases, data leakage, etc., introduced during the training stage.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

Multimodal Relational Interpretation for Deep Models. 01/05/2020 - 30/04/2024

Abstract

Interpretation and explanation of deep models is critical towards wide adoption of systems that rely on them. Model interpretation consists on getting an insight on the information learned by a model from a set of examples. Model explanation focuses on justifying the predictions made by a model on a given input. While there a is a continuously increasing amount of efforts addressing the task of model explanation, its interpretation counterpart has received significant less attention. In this project we aim taking a solid step forward on the interpretation and understanding of deep neural networks. More specifically, we will focus our efforts on four complementary directions. First, by reducing the computational costs of model interpretation algorithms and by improving the clarity of the visualizations they produce. Second, by developing interpretation algorithms that are capable of discovering complex structures encoded in the models to be interpreted. Third, by developing algorithms to produce multimodal interpretations based on different types of data such as images and text. Fourth, by proposing an evaluation protocol to objectively assess the performance of algorithms for model interpretation. As a result, we aim to propose a set of principles and foundations that can be followed to improve the understanding of any existing or future deep complex model.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

IMEC-A-Budget: 2021. 01/01/2020 - 31/12/2021

Abstract

This project combines the USP of different imec groups on localisation and focusses on massive localisation systems (long range, large density) using sub-Ghz, but also includes large density accurate localisation using UWB.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project

IMEC-A-Budget: 2020. 01/01/2020 - 31/12/2020

Abstract

This project combines the USP of different imec groups on localisation and focusses on massive localisation systems (long range, large density) using sub-Ghz, but also includes large density accurate localisation using UWB.

Researcher(s)

Research team(s)

Project type(s)

  • Research Project