Deep reinforcement learning for optimal well control in subsurface systems with uncertain geology

DOI10.1016/j.jcp.2023.111945OpenAlexW4320473119MaRDI QIDQ2683244

Yusuf Nasir, Louis J. Durlofsky

Publication date: 10 February 2023

Published in: Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2203.13375

zbMATH Keywords

stochastic optimal controlreservoir simulationtransformersdeep reinforcement learningproximal policy optimizationclosed-loop modeling

Mathematics Subject Classification ID

Mathematical programming (90Cxx) Artificial intelligence (68Txx) Geophysics (86Axx)

Related Items (1)

Multi-asset closed-loop reservoir management using deep reinforcement learning

Uses Software

• SNOPT
• AS 136
• Adam
• Tensor2Tensor
• RLlib

Cites Work

• Algorithm AS 136: A K-Means Clustering Algorithm
• AS 136
• RLlib
• Enhanced linearized reduced-order models for subsurface flow simulation
• Data assimilation and uncertainty assessment for complex geological models using a new PCA-based parameterization
• A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems
• A new differentiable parameterization based on principal component analysis for the low-dimensional representation of complex geological models
• Partitions of partitions
• Adjoint formulation and constraint handling for gradient-based optimization of compositional reservoir flow
• Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
• Conditional simulation of complex geological structures using multiple-point statistics
• Use of low-fidelity models with machine-learning error correction for well placement optimization
• Direct shape optimization through deep reinforcement learning
• Deep reinforcement learning for the control of conjugate heat transfer
• Closed-loop stochastic oilfield optimization for hedging against geologic, development, and operation uncertainty
• Theory-guided auto-encoder for surrogate construction and inverse modeling
• A deep-learning-based geological parameterization for history matching complex models
• Reduced-order optimal control of water flooding using proper orthogonal decomposition
• An Introduction to Statistical Learning
• SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization

This page was built for publication: Deep reinforcement learning for optimal well control in subsurface systems with uncertain geology