A city crew truck is seen driving down a flooded street in a downpour
Lise St. Denis, a research scientist at the University of Colorado’s Earth Lab, has spent the past half-decade figuring out how to find useful information on social media in the wake of natural disasters like the flooding seen here.
Mario Beauregard/Adobe

Finding critical information during disasters

Lise St. Denis, a research scientist at the University of Colorado, says social media can be useful for responders. Now she's helping them separate truly useful info from the noise.

Twitter, apart from being a place to catch up on niche topics and post personal takes on the latest news, can be a useful source of vital information during disasters.

Lise St. Denis, a research scientist at the University of Colorado’s Earth Lab, notes social media sites of all stripes can be useful in storms, but also in wildfires, floods, hurricanes, and other natural disasters — because fast, local information is essential in these situations. However, separating truly useful info from the noise is key, which is what St. Denis has been working on for the past half-decade.

“My big vision is that emergency response teams and communities impacted by disasters could get the best possible information out in real time so communities can be optimally informed about what's happening,” she says.

This kind of work requires a marriage of creative thinking and technology, something St. Denis, a 2019 AWS Machine Learning Research Award recipient, has pursued since the beginning of her career.

Lise St. Denis is seen wearing a mask and standing, on the left, while teaching a recent graduate seminar. There is a display screen behind her and two students, also masked, are seen sitting.
Lise St. Denis is seen standing while teaching a recent graduate seminar. After earning her PhD at the University of Colorado in 2016, St. Denis stayed on and is now a research scientist at Earth Lab
Courtesy of Lise St. Denis

At least as far back as college, St. Denis has had a variety of interests she took seriously, despite their seeming disparity. Her undergrad degrees from Colorado State University are in fine arts and computer science. That brought her to illustration and software engineering in her early working life, first at Hewlett Packard. HP supported her graduate work in human factors engineering at the University of Idaho.

She took a break when she had children in the early 2000s, and when she was ready to return to the workforce, she realized she wanted to refine her skills. “I still had a lot of the same interests, but with a different life perspective — I was older. I wanted to do something that I felt like I was making a difference,” says St. Denis. So she went back to graduate school in 2011 initially for a masters in computer science, which led her to the University of Colorado where she discovered Project EPIC (Empowering the Public with Information in Crisis) where she decided to pursue an interdisciplinary doctorate in crisis informatics.

As part of the work for her degree, she met a group of emergency responders, became fascinated by their work, and set out to learn more. She realized that one big challenge they faced was getting the word out to the public. Could, she wondered, social media sites help gather and distribute information?

So when she heard about a plan in New Mexico to adapt the idea of digital volunteerism to emergency risk response — the volunteers in this case would be emergency responders — she went to learn from them.

At the time, social media wasn’t widely embraced within the emergency response field; St. Denis even knew government officials who risked their jobs using social media at work. “A lot of emergency response organizations just saw social media, not as useful, but as more of a hotbed for misinformation and rumor,” says St. Denis.

Even in light of that, some emergency managers remained interested: “As social media gained popularity, they knew this is where they needed to provide updates, engage with a growing audience, and look for breaking information,” recalls St. Denis.

“They formed this network of teams that were called Virtual Operational Support Teams. These teams are known ahead of time and activated through formal emergency protocols and procedures. The first emergency trial of the concept was during the 2011 Shadow Lake Fire in Eastern Oregon. I ended up studying the innovations of this network of teams, and I worked within this community, alongside them, to understand what they were doing,” she explained.

Their work made sense to St. Denis, and so, instead of getting that master’s in computer science, she ended up using what she had learned in New Mexico as a basis for her cross-disciplinary PhD, which included computer science, but also incorporated classes in communication and sociology of disaster.

In 2014, St. Denis was asked to bring her reporting and analysis social media skills to the Carlton Complex fire in Eastern Washington. That fire burned through several communities with a high number of structures lost and very short evacuation windows. Unable to keep up with the speed of the fire’s impact, locals had no way to get their questions answered and there was, understandably, a lot of frustration.

“That convinced me that there had to be a better strategy for filtering and getting to the most relevant information needed during these events,” she says.

She was also wrangling data and doing analysis, and consolidating that information for the teams she was supporting. As part of her research, St. Denis was a part of close to 100 emergency response activations. “I studied the integration of social media into emergency response through virtual teams,” she explains. “And I kept asking myself, ‘What does it mean to integrate them?’”

Fast forward to today and she’s still researching that basic question. After earning her PhD at the University of Colorado in 2016, St. Denis stayed on at the university and is now a research scientist at Earth Lab. “We have all this existing information from all these different sources, and we want to do a better job of making it available so scientists can leverage it and make use of it for hazards analysis.”

Thus far, Twitter has shown the most promise for what St. Denis hopes to implement. The idea is that an emergency manager would receive a live stream of truly useful content, including selected tweets from reliable sources. “The managers could keep an eye on that as part of their emergency management response,” says St. Denis.

This is extremely practical, real-world information, that can help save lives because it is personalized, says St. Denis. The information is coming from community members who are directly impacted by these disasters. “It's not the media coverage or the broad outside information,” says St. Denis. “It contains new information such as what roads are passable or where fuel outages exist” or where information gaps exist such as, ‘I don't know where to evacuate my livestock,’ or ‘I need to know who has gas,’ or ‘Is my water supply safe to drink?’”

And while her research hasn’t yet translated into an actual tool for emergencies, St. Denis sees the light around the corner. She recently became part of the Pandemic Hyper-Accelerator for Science and Technology (PHAST). “As part of the PHAST program I have been paired with skilled entrepreneurs who are helping me to look at my problem from a systematic, opportunity-driven perspective,” she explains. “We’ve been interviewing emergency response and crisis response professionals across different contexts to understand specifics about the tools they are using, as well as the specific values of or consequences for information when it is found or not found.”

Utilizing machine learning

St. Denis first realized she would need to utilize machine learning when studying data from the Carlton Complex fire. “I realized that I had some intuition for how I could take the noise off the top to get to the information that I wanted. But the only way that was going to matter is if I could do that in near real time — which would require machine learning,” she says. So she applied for an AWS Machine Learning Research Award and received it in 2019.

She and her team used AWS Lambda and AWS Fargate to query the Twitter API for relevant tweets, and stored the raw data in Amazon S3. St. Denis also used standard machine learning libraries to build her prototype because she wanted everything to be open source. “We're hoping, as we move forward, to move into more sophisticated data collection and AWS tools,” she says.

St. Denis and her team have published two papers on the design of the work done so far, and proved that the prototype they’ve built works equally well across multiple types of hazards. They’ve even used it for work they did examining US-based public response to stay-at-home orders at the onset of the COVID-19 pandemic.

“I have spent over a decade working with some of the most innovative responders in the field, but fundamentally nothing has changed in terms of tools,” she says. “I think that this social media-based tool has a lot of potential, and so it's been really exciting. Now that I have this starter funding, it could go pretty quickly.”

Related content

US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Member of Technical Staff with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Member of Technical Staff with the AGI team, you will lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. You will lead the foundational model development in an applied research role, including model training, dataset design, and pre- and post-training optimization. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, WA, Redmond
We are searching for a talented candidate with experience in orbital mechanics, orbit determination, launch vehicle trajectories, and launch vehicle mission planning. In this position, a successful candidate would serve as a Research Scientist in support of Amazon Leo’s constellation with particular focus on Launch Vehicle support. Strong analysis skills are required to develop engineering studies of complex large-scale dynamical systems. This position requires demonstrated expertise in computational analysis automation and tool development. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. Key job responsibilities Working with the Leo GNC team, you will: • Perform spacecraft maneuver or navigation analysis in support of multi-disciplinary trades within the Amazon Leo team. • Contribute to prototype software development of flight algorithms. • Test and assess navigation software for integration into flight systems. • Assess and trouble-shoot the performance of Leo on-board GNSS hardware and software systems. • Work closely with GNC engineers to manage on-orbit performance and develop flight dynamics operations processes. • Manage engineering trades as needed for various launch vehicle mission designs. • Support Leo’s Launch Vehicle Mission Management team with technical expertise in Launch Vehicle trajectory requirements specification • Evaluate Launch Vehicle performance and compliance with mission requirements • Develop tools to support Mission Management planning for over 80 launches! • Work collaboratively with launch vehicle system technical teams About the team The Flight Dynamics team is responsible for the guidance, navigation, control and safety of the spaceflight of the Amazon Leo constellation. This team provides solutions to spaceflight challenges in constellation design, orbit selection, launch vehicle insertion requirements, navigation, trajectory design, space situational awareness, and space traffic coordination.
US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Member of Technical Staff with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Member of Technical Staff with the AGI team, you will lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. You will lead the foundational model development in an applied research role, including model training, dataset design, and pre- and post-training optimization. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Member of Technical Staff with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Member of Technical Staff with the AGI team, you will lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. You will lead the foundational model development in an applied research role, including model training, dataset design, and pre- and post-training optimization. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Member of Technical Staff with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Member of Technical Staff with the AGI team, you will lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. You will lead the foundational model development in an applied research role, including model training, dataset design, and pre- and post-training optimization. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Member of Technical Staff with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Member of Technical Staff with the AGI team, you will lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. You will lead the foundational model development in an applied research role, including model training, dataset design, and pre- and post-training optimization. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, WA, Seattle
We are looking for a Principal Applied Scientist to drive the research and development of real-time multimodal conversational AI. You will operate across two focus areas: advancing foundation models for speech and audio, and building the post-training systems (reward modeling, reinforcement learning) that shape natural, human-like conversational behavior. You will be the expert in your area while contributing across the full model lifecycle — from pre-training and architecture design through post-training alignment and real-time deployment. You will work at the frontier of what's possible in conversational AI, with the compute, data, and runway to pursue problems that few teams in the world have the resources to tackle. As a Principal Scientist, you will set the technical direction for your research area, influence the broader roadmap, and work closely with inference engineers to ensure your models are designed for real-time production deployment from inception. Key job responsibilities Foundation Model Scaling - Build and train large-scale multimodal foundation models for real-time speech and audio generation, from architecture design through production-scale training - Advance the scaling and efficiency of conversational modes, including the relationship between data, model size, and real time performance. - Design model architectures informed by hardware constraints and inference requirements, working with inference engineers to ensure models are servable from inception - Develop training methodologies for multimodal models that jointly process and generate speech, language, and audio in real-time streaming contexts Post-Training & Reinforcement Learning - Design and build reward models and reward functions for speech systems — capturing naturalness, fluency, conversational quality, and real-time responsiveness - Develop and apply reinforcement learning methods to shape conversational behavior — teaching models natural timing, responsiveness, and fluid interaction - Build the post-training pipeline from SFT through RL alignment, optimized for real-time multimodal outputs rather than text-only generation - Design evaluation frameworks that capture the quality dimensions unique to real-time conversation Real-Time Perception & Generation - Advance the team's capabilities in real-time perception - Work at the intersection of model architecture and production constraints to ensure multimodal capabilities function within hard real-time latency budgets
IN, KA, Bengaluru
Amazon is looking for a passionate, talented, and inventive Data Scientist with machine learning background to help build industry-leading Speech and Language technology. Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), Machine Learning (ML). Key job responsibilities Key job responsibilities Amazon is looking for a passionate, talented, and inventive Data Scientist with machine learning background to help build industry-leading Speech and Language technology. Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), Machine Learning (ML) and Computer Vision (CV). As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop data experiments, novel algorithms and data techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services that make use of speech and language technology. You will gain hands on experience with Amazon’s heterogeneous speech, text, and structured data sources, and large-scale computing resources to accelerate advances in spoken language understanding.
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video technologist, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! We are looking for a self-motivated, passionate and resourceful Applied Scientist to bring diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. You will spend your time as a hands-on machine learning practitioner and a research leader. You will play a key role on the team, building and guiding machine learning models from the ground up. At the end of the day, you will have the reward of seeing your contributions benefit millions of Amazon.com customers worldwide. Key job responsibilities Develop AI solutions for various Prime Video Personalization systems using Deep learning, GenAI, Reinforcement Learning, and optimization methods; Work closely with engineers and product managers to design, implement and launch AI solutions end-to-end; Design and conduct offline and online (A/B) experiments to evaluate proposed solutions based on in-depth data analyses; Effectively communicate technical and non-technical ideas with teammates and stakeholders; Stay up-to-date with advancements and the latest modeling techniques in the field; Publish your research findings in top conferences and journals. About the team Prime Video Personalization and Discovery team owns science solution to power personalized experience on various devices, from sourcing, relevance, ranking, to name a few. We work closely with the engineering and product teams to launch our solutions in production.
US, WA, Seattle
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their causal inference / structural econometrics skillsets to solve real world problems. The intern will work in the area of Store Economics and Science (SEAS) and develop models to SEAS. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. About the team The Stores Economics and Science Team (SEAS) is a Stores-wide interdisciplinary team at Amazon with a "peak jumping" mission focused on disruptive innovation. The team applies science, economics, and engineering expertise to tackle the business's most critical problems, working to move from local to global optima across Amazon Stores operations. SEAS builds partnerships with organizations throughout Amazon Stores to pursue this mission, exploring frontier science while learning from the experience and perspective of others. Their approach involves testing solutions first at a small scale, then aligning more broadly to build scalable solutions that can be implemented across the organization. The team works backwards from customers using their unique scientific expertise to add value, takes on long-run and high-risk projects that business teams typically wouldn't pursue, helps teams with kickstart problems by building practical prototypes, raises the scientific bar at Amazon, and builds and shares software that makes Amazon more productive.