Jul 23 03:10:11 devstack cinder-volume[77337]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 23 03:10:11 devstack cinder-volume[77337]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 23 03:10:11 devstack cinder-volume[77337]: we strongly recommend against using it for new projects.
Jul 23 03:10:11 devstack cinder-volume[77337]: If you are already using Eventlet, we recommend migrating to a different
Jul 23 03:10:11 devstack cinder-volume[77337]: framework.  For more detail see
Jul 23 03:10:11 devstack cinder-volume[77337]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 23 03:10:11 devstack cinder-volume[77337]:   import eventlet  # noqa
Jul 23 03:10:14 devstack cinder-volume[77337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:10:14 devstack cinder-volume[77337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:10:14 devstack cinder-volume[77337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:10:15 devstack cinder-volume[77337]: INFO dbcounter [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Registered counter for database cinder
Jul 23 03:10:15 devstack cinder-volume[77337]: DEBUG oslo_db.sqlalchemy.engines [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:10:15 devstack cinder-volume[77337]: DEBUG dbcounter [-] [77337] Writer thread running {{(pid=77337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 23 03:10:15 devstack cinder-volume[77337]: INFO cinder.rpc [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO cinder.rpc [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_db.sqlalchemy.engines [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO cinder.volume.manager [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Determined volume DB was empty at startup.
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG cinder.volume.manager [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77337) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO cinder.volume.manager [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 23 03:10:16 devstack cinder-volume[77337]: WARNING stevedore.named [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 23 03:10:16 devstack cinder-volume[77337]: WARNING castellan.key_manager [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:10:16 devstack cinder-volume[77337]: WARNING cinder.keymgr.conf_key_mgr [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG cinder.volume.drivers.lvm [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77337) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_concurrency.processutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_concurrency.processutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] CMD "cinder-rtstool verify" returned: 0 in 0.505s {{(pid=77337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_db.sqlalchemy.engines [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO cinder.rpc [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO cinder.rpc [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 23 03:10:16 devstack cinder-volume[77337]: WARNING stevedore.named [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 23 03:10:16 devstack cinder-volume[77337]: WARNING castellan.key_manager [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO cinder.volume.manager [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_db.sqlalchemy.engines [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:10:16 devstack cinder-volume[77337]: INFO oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Starting 1 workers
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Started child 77480 {{(pid=77337) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Full set of CONF: {{(pid=77337) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] ******************************************************************************** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Configuration options gathered from: {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] ================================================================================ {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] allow_availability_zone_fallback = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] allow_compression_on_image_upload = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] allowed_direct_url_schemes     = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] api_rate_limit                 = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] auth_strategy                  = keystone {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] az_cache_duration              = 3600 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_availability_zone      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_host                   = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_name                   = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_stats_polling_interval = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backup_api_class               = cinder.backup.api.API {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backup_name_template           = backup-%s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backup_use_same_host           = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backup_use_temp_snapshot       = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] chap_password                  = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] chap_username                  =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_internal_tenant_project_id = ac2389517b354272b8890e660e03e112 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_internal_tenant_user_id = 21fa476fde1040bda589046d3f5c2ab8 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77480]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cloned_volume_same_az          = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cluster                        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] compression_format             = gzip {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] compute_api_class              = cinder.compute.nova.API {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] config_dir                     = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] config_source                  = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] control_exchange               = openstack {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] debug                          = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] default_availability_zone      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] default_group_type             = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] default_volume_type            = lvmdriver-1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] disk_geometry                  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] driver_client_cert             = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] driver_client_cert_key         = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] driver_data_namespace          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] driver_ssl_cert_path           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] driver_ssl_cert_verify         = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] driver_use_ssl                 = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] enable_force_upload            = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] enable_new_services            = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] enable_unsupported_driver      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] enabled_backends               = ['lvmdriver-1'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] enforce_multipath_for_image_xfer = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] filter_function                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_api_insecure            = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_api_servers             = ['http://192.168.122.85/image'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_api_ssl_compression     = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_ca_certificates_file    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_catalog_info            = image:glance:publicURL {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_certfile                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_keyfile                 = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_num_retries             = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance_request_timeout         = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] goodness_function              = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] graceful_shutdown_timeout      = 5 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] group_api_class                = cinder.group.api.API {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] host                           = devstack {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_compress_on_upload       = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_conversion_address_space_limit = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_conversion_cpu_limit     = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_conversion_disable       = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_upload_use_cinder_backend = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_upload_use_internal_tenant = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_volume_cache_enabled     = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_volume_cache_max_count   = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] image_volume_cache_max_size_gb = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] init_host_max_objects_retrieval = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] instance_format                = [instance: %(uuid)s]  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] iscsi_target_flags             =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] iscsi_write_cache              = on {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] iser_helper                    = tgtadm {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] iser_ip_address                = 192.168.122.85 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] iser_port                      = 3260 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_color                      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_config_append              = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_dir                        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_file                       = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_options                    = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_rotate_interval            = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_rotate_interval_type       = days {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] log_rotation_type              = none {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] max_age                        = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] max_logfile_count              = 30 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] max_logfile_size_mb            = 200 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] max_over_subscription_ratio    = 20.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] message_reap_interval          = 86400 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] message_ttl                    = 2592000 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] migration_create_volume_timeout_secs = 300 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] monkey_patch                   = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] monkey_patch_modules           = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] my_ip                          = 192.168.122.85 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] no_snapshot_gb_quota           = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] num_iser_scan_tries            = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] num_shell_tries                = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] num_volume_device_scan_tries   = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] nvmeof_conn_info_version       = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] nvmet_ns_id                    = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] nvmet_port_id                  = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_max_limit                = 1000 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_volume_ext_list          = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_volume_listen_port       = 8776 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_volume_use_ssl           = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] osapi_volume_workers           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] per_volume_size_limit          = -1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] periodic_fuzzy_delay           = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] periodic_interval              = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] public_endpoint                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] publish_errors                 = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_backup_gigabytes         = 1000 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_backups                  = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_gigabytes                = 1000 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_groups                   = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_snapshots                = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] quota_volumes                  = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] rate_limit_burst               = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] rate_limit_except_level        = CRITICAL {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] rate_limit_interval            = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] reinit_driver_count            = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] replication_device             = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] report_discard_supported       = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] report_interval                = 120 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] reservation_clean_interval     = 86400 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] reservation_expire             = 86400 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] reserved_image_namespaces      = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] reserved_percentage            = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77480]: INFO cinder.volume.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] rpc_response_timeout           = 120 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] run_external_periodic_tasks    = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] scst_target_driver             = iscsi {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] scst_target_iqn_name           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_down_time              = 720 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] shell_completion               = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] snapshot_name_template         = snapshot-%s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] snapshot_same_host             = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] split_loggers                  = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] state_path                     = /opt/stack/data/cinder {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] storage_availability_zone      = nova {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] storage_protocol               = iSCSI {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] syslog_log_facility            = LOG_USER {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] target_helper                  = lioadm {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] target_ip_address              = 192.168.122.85 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] target_port                    = 3260 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:16 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] target_protocol                = iscsi {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] target_secondary_ip_addresses  = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] trace_flags                    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] transport_url                  = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] until_refresh                  = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_chap_auth                  = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_default_quota_class        = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_journal                    = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_json                       = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_multipath_for_image_xfer   = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_stderr                     = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] use_syslog                     = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] verify_glance_signatures       = enabled {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_api_class               = cinder.volume.api.API {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_backend_name            = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_clear                   = zero {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_clear_ionice            = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_clear_size              = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_copy_bps_limit          = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_dd_blocksize            = 1M {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_name_template           = volume-%s {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_service_inithost_offload = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volume_usage_audit_period      = month {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] zoning_mode                    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_concurrency.disable_process_locking = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:16 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.auth_section = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.auth_type   = password {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.auth_version = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.cache       = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.certfile    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.delay_auth_decision = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.http_connect_timeout = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.include_service_catalog = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.insecure    = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.interface   = public {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.keyfile     = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_password =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcache_username =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.region_name = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.service_token_roles_required = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.service_type = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.token_cache_time = 300 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.85/identity {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.backend                  = dogpile.cache.null {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.backend_argument         = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.backend_expiration_time  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.config_prefix            = cache.oslo {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.debug_cache_backend      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.enable_retry_client      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.enable_socket_keepalive  = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.enabled                  = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.expiration_time          = 600 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.hashclient_retry_attempts = 2 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_dead_retry      = 300 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_pool_maxsize    = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_sasl_enabled    = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.password                 = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.proxies                  = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.redis_db                 = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.redis_sentinel_service_name = mymaster {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.redis_server             = localhost:6379 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.retry_attempts           = 2 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.retry_delay              = 0.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.socket_keepalive_count   = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.socket_keepalive_idle    = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.socket_keepalive_interval = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.socket_timeout           = 1.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.tls_allowed_ciphers      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.tls_cafile               = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.tls_certfile             = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.tls_enabled              = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.tls_keyfile              = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cache.username                 = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] coordination.backend_url       = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.asyncio_connection    = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.asyncio_slave_connection = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.backend               = sqlalchemy {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.connection            = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.connection_debug      = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.connection_parameters =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.connection_recycle_time = 3600 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.connection_trace      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.db_inc_retry_interval = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.db_max_retries        = 20 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.db_max_retry_interval = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.db_retry_interval     = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.max_overflow          = 50 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.max_pool_size         = 5 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.max_retries           = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.mysql_wsrep_sync_wait = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.pool_timeout          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.retry_interval        = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.slave_connection      = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.sqlite_synchronous    = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.synchronous_reader    = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] database.use_db_reconnect      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.connection_string     = messaging:// {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.enabled               = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.es_doc_type           = notification {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.es_scroll_size        = 10000 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.es_scroll_time        = 2m {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.filter_error_trace    = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.hmac_keys             = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.sentinel_service_name = mymaster {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.socket_timeout        = 0.1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.trace_requests        = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler.trace_sqlalchemy      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler_jaeger.process_tags   = {} {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler_jaeger.service_name_prefix = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] profiler_otlp.service_name_prefix = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.enforce_new_defaults = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.policy_default_rule = default {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.policy_file        = policy.yaml {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.group          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.helper_command = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] privsep_osbrick.user           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.group         = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.helper_command = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] cinder_sys_admin.user          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.auth_section      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.auth_type         = password {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.cafile            = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.certfile          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.collect_timing    = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.insecure          = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.keyfile           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.send_service_user_token = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.split_loggers     = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] service_user.timeout           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.auth_section            = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.auth_type               = password {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.certfile                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.collect_timing          = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.insecure                = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.keyfile                 = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.region_name             = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.split_loggers           = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] glance.timeout                 = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.backend_availability_zone = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack sudo[77503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.chap_password = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.chap_username =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack sudo[77503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.disk_geometry = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.driver_client_cert = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.driver_client_cert_key = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.driver_data_namespace = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.driver_use_ssl = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.enable_unsupported_driver = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.extra_capabilities = {} {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.filter_function = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.goodness_function = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.iscsi_target_flags =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.iscsi_write_cache = on {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.iser_helper   = tgtadm {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.iser_port     = 3260 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.lvm_mirrors   = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.lvm_share_target = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.lvm_type      = auto {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.num_shell_tries = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.nvmet_port_id = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.replication_device = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.report_discard_supported = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.reserved_percentage = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.scst_target_driver = iscsi {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.scst_target_iqn_name = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.storage_protocol = iSCSI {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.target_helper = tgtadm {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.target_port   = 3260 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.target_protocol = iscsi {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.trace_flags   = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.unique_fqdn_network = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.use_chap_auth = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_backend_name = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_clear  = zero {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_clear_ionice = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_clear_size = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volume_group  = cinder-volumes {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_reports.file_event_handler = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_reports.log_dir           = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.backend_availability_zone = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.backend_host       = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.chap_password      = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.chap_username      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.chiscsi_conf       = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.disk_geometry      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.driver_client_cert = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.driver_data_namespace = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.driver_use_ssl     = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.extra_capabilities = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.filter_function    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.goodness_function  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.iser_helper        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.iser_ip_address    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.iser_port          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.iser_target_prefix = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.lvm_conf_file      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.lvm_mirrors        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.lvm_share_target   = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.lvm_type           = auto {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.num_shell_tries    = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.nvmet_port_id      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.replication_device = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.report_discard_supported = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.reserved_percentage = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.scst_target_driver = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.storage_protocol   = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.target_helper      = lioadm {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.target_ip_address  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.target_port        = 3260 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.target_protocol    = iscsi {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.trace_flags        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.use_chap_auth      = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_clear       = zero {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_clear_size  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] lvmdriver-1.volumes_dir        = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl      = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_notifications.driver = [] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_notifications.retry = -1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] oslo_messaging_notifications.transport_url = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] key_manager.fixed_key          = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.barbican_api_version  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.barbican_endpoint     = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.barbican_endpoint_type = public {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.barbican_region_name  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.cafile                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.certfile              = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.collect_timing        = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.insecure              = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.keyfile               = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.number_of_retries     = 60 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.retry_delay           = 1 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.send_service_user_token = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.split_loggers         = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.timeout               = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.verify_ssl            = True {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican.verify_ssl_path       = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.auth_section = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.auth_type = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.cafile   = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.certfile = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.collect_timing = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.insecure = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.keyfile  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.split_loggers = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] barbican_service_user.timeout  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.approle_role_id          = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.approle_secret_id        = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.auth_method              = approle {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.auth_path                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.kv_mountpoint            = secret {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.kv_path                  = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.kv_version               = 2 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.namespace                = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.root_token_id            = **** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.ssl_ca_crt_file          = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.timeout                  = 60.0 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.token_file               = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.token_role               = None {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.use_ssl                  = False {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:10:17 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] ******************************************************************************** {{(pid=77337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 23 03:10:17 devstack sudo[77503]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:17 devstack sudo[77631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:17 devstack sudo[77631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:17 devstack sudo[77631]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.254s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:10:17 devstack cinder-volume[77480]: INFO cinder.brick.local_dev.lvm [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:17 devstack sudo[77725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:10:17 devstack sudo[77725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:17 devstack sudo[77725]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG cinder.brick.local_dev.lvm [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77480) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 23 03:10:17 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:17 devstack sudo[77798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:17 devstack sudo[77798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:18 devstack sudo[77798]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:18 devstack sudo[77988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:18 devstack sudo[77988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:18 devstack sudo[77988]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:18 devstack sudo[78088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 23 03:10:18 devstack sudo[78088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:18 devstack sudo[78088]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.255s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:18 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:18 devstack sudo[78091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:10:18 devstack sudo[78091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:19 devstack sudo[78091]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:19 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:19 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:19 devstack sudo[78174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:10:19 devstack sudo[78174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:19 devstack sudo[78174]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:19 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:19 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:19 devstack sudo[78177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:19 devstack sudo[78177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:19 devstack sudo[78177]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:19 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:19 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:19 devstack sudo[78236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:19 devstack sudo[78236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:20 devstack sudo[78236]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:20 devstack sudo[78270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:20 devstack sudo[78270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:20 devstack sudo[78270]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:20 devstack cinder-volume[77480]: INFO cinder.volume.drivers.lvm [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:20 devstack sudo[78274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:20 devstack sudo[78274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:20 devstack sudo[78274]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG cinder.volume.drivers.lvm [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Updating volume stats {{(pid=77480) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 23 03:10:20 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:20 devstack sudo[78277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:10:20 devstack sudo[78277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:21 devstack sudo[78277]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:21 devstack sudo[78300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:21 devstack sudo[78300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:21 devstack sudo[78300]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:21 devstack sudo[78325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:21 devstack sudo[78325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:21 devstack sudo[78325]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:21 devstack sudo[78329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:21 devstack sudo[78329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:21 devstack sudo[78329]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:21 devstack cinder-volume[77480]: INFO cinder.volume.driver [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Driver hasn't implemented _init_vendor_properties()
Jul 23 03:10:21 devstack cinder-volume[77480]: DEBUG cinder.volume.driver [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77480) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_db.sqlalchemy.engines [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77480) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG dbcounter [-] [77480] Writer thread running {{(pid=77480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG cinder.db.api [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Building query based on filter {{(pid=77480) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG cinder.image.image_utils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77480) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 23 03:10:22 devstack cinder-volume[77480]: INFO cinder.keymgr.migration [None req-9cd45947-d466-4769-b02c-b6442a4c97cf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG cinder.volume.drivers.lvm [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Updating volume stats {{(pid=77480) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:22 devstack sudo[78333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:10:22 devstack sudo[78333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:22 devstack sudo[78333]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:22 devstack sudo[78337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:22 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:22 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:22 devstack sudo[78340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:22 devstack sudo[78340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:22 devstack sudo[78340]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:22 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:22 devstack sudo[78344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:22 devstack sudo[78344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:23 devstack sudo[78344]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG cinder.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Notifying Schedulers of capabilities ... {{(pid=77480) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:10:23 devstack cinder-volume[77480]: INFO cinder.volume.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Driver initialization completed successfully.
Jul 23 03:10:23 devstack cinder-volume[77480]: INFO cinder.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Initiating service 2 cleanup
Jul 23 03:10:23 devstack cinder-volume[77480]: INFO cinder.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Service 2 cleanup completed.
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG cinder.service [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Creating RPC server for service cinder-volume {{(pid=77480) start /opt/stack/cinder/cinder/service.py:231}}
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG cinder.service [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77480) start /opt/stack/cinder/cinder/service.py:237}}
Jul 23 03:10:23 devstack cinder-volume[77480]: INFO cinder.volume.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG cinder.volume.drivers.lvm [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Updating volume stats {{(pid=77480) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:23 devstack sudo[78348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:10:23 devstack sudo[78348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:23 devstack sudo[78348]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:23 devstack sudo[78351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:23 devstack sudo[78351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:23 devstack sudo[78351]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:23 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:23 devstack sudo[78354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:10:23 devstack sudo[78354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:24 devstack sudo[78354]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:24 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:24 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:10:24 devstack sudo[78357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:10:24 devstack sudo[78357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:10:24 devstack sudo[78357]: pam_unix(sudo:session): session closed for user root
Jul 23 03:10:24 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:10:24 devstack cinder-volume[77480]: INFO cinder.volume.manager [None req-fefb393e-056c-4317-9195-34ffbfb01490 None None] Driver post RPC initialization completed successfully.
Jul 23 03:10:26 devstack cinder-volume[77337]: DEBUG dbcounter [-] [77337] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:10:34 devstack cinder-volume[77480]: DEBUG dbcounter [-] [77480] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:10:34 devstack cinder-volume[77480]: DEBUG dbcounter [-] [77480] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:10:59 devstack cinder-volume[77480]: DEBUG oslo_service.periodic_task [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running periodic task VolumeManager._thread_info {{(pid=77480) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:10:59 devstack cinder-volume[77480]: DEBUG cinder.volume.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] thread count: 6 {{(pid=77480) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:10:59 devstack cinder-volume[77480]: DEBUG cinder.volume.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] thread info: [<_MainThread(MainThread, started 137828653908096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137828546322752)>, <Thread(Thread-3 (stat_writer), started daemon 137828541965184)>, <Thread(Rabbit-heartbeat, started daemon 137828541958784)>, <Thread(Thread-5 (_runner), started daemon 137828539497152)>, <Thread(Thread-7 (_runner), started daemon 137828539506112)>] {{(pid=77480) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG oslo_service.periodic_task [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77480) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG cinder.volume.drivers.lvm [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Updating volume stats {{(pid=77480) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:11:59 devstack sudo[83523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:11:59 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:11:59 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:11:59 devstack sudo[83526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:11:59 devstack sudo[83526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:11:59 devstack sudo[83526]: pam_unix(sudo:session): session closed for user root
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:11:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:11:59 devstack sudo[83529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:11:59 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:12:00 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:12:00 devstack sudo[83532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:12:00 devstack sudo[83532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:12:00 devstack sudo[83532]: pam_unix(sudo:session): session closed for user root
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG cinder.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Notifying Schedulers of capabilities ... {{(pid=77480) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG oslo_service.periodic_task [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running periodic task VolumeManager._thread_info {{(pid=77480) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG cinder.volume.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] thread count: 6 {{(pid=77480) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:12:00 devstack cinder-volume[77480]: DEBUG cinder.volume.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] thread info: [<_MainThread(MainThread, started 137828653908096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137828546322752)>, <Thread(Thread-3 (stat_writer), started daemon 137828541965184)>, <Thread(Rabbit-heartbeat, started daemon 137828541958784)>, <Thread(Thread-5 (_runner), started daemon 137828539497152)>, <Thread(Thread-7 (_runner), started daemon 137828539506112)>] {{(pid=77480) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:12:34 devstack cinder-volume[77480]: DEBUG dbcounter [-] [77480] Writing DB stats cinder:SELECT=1 {{(pid=77480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:12:34 devstack cinder-volume[77480]: DEBUG dbcounter [-] [77480] Writing DB stats cinder:UPDATE=1 {{(pid=77480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG oslo_service.periodic_task [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77480) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG cinder.volume.drivers.lvm [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Updating volume stats {{(pid=77480) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:12:59 devstack sudo[85030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:12:59 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:12:59 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:12:59 devstack sudo[85065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:12:59 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:12:59 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:12:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:12:59 devstack sudo[85072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:12:59 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:13:00 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root
Jul 23 03:13:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:13:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:13:00 devstack sudo[85082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:13:00 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:13:00 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root
Jul 23 03:13:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:13:00 devstack cinder-volume[77480]: DEBUG cinder.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Notifying Schedulers of capabilities ... {{(pid=77480) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG oslo_service.periodic_task [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77480) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG cinder.volume.drivers.lvm [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Updating volume stats {{(pid=77480) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:13:59 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 23 03:13:59 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:13:59 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:13:59 devstack sudo[86504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:13:59 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:13:59 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:13:59 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:13:59 devstack sudo[86530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 23 03:13:59 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:14:00 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:14:00 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 23 03:14:00 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:14:00 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG oslo_concurrency.processutils [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77480) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG cinder.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Notifying Schedulers of capabilities ... {{(pid=77480) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG oslo_service.periodic_task [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] Running periodic task VolumeManager._thread_info {{(pid=77480) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG cinder.volume.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] thread count: 6 {{(pid=77480) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:14:00 devstack cinder-volume[77480]: DEBUG cinder.volume.manager [None req-5438a9f4-9b99-467d-b9ce-f628feecd09e None None] thread info: [<_MainThread(MainThread, started 137828653908096)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137828546322752)>, <Thread(Thread-3 (stat_writer), started daemon 137828541965184)>, <Thread(Rabbit-heartbeat, started daemon 137828541958784)>, <Thread(Thread-5 (_runner), started daemon 137828539497152)>, <Thread(Thread-7 (_runner), started daemon 137828539506112)>] {{(pid=77480) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:14:34 devstack cinder-volume[77480]: DEBUG dbcounter [-] [77480] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77480) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:14:45 devstack cinder-volume[77337]: INFO oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Caught SIGTERM, stopping children
Jul 23 03:14:45 devstack cinder-volume[77337]: DEBUG oslo_concurrency.lockutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Acquiring lock "singleton_lock" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:14:45 devstack cinder-volume[77337]: DEBUG oslo_concurrency.lockutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Acquired lock "singleton_lock" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:14:45 devstack cinder-volume[77337]: DEBUG oslo_concurrency.lockutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Releasing lock "singleton_lock" {{(pid=77337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:14:45 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Stop services. {{(pid=77337) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 23 03:14:45 devstack cinder-volume[77337]: DEBUG oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Killing children. {{(pid=77337) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 23 03:14:45 devstack cinder-volume[77337]: INFO oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Waiting on 1 children to exit
Jul 23 03:14:48 devstack cinder-volume[77480]: DEBUG oslo_concurrency.lockutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Acquiring lock "singleton_lock" {{(pid=77480) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:14:48 devstack cinder-volume[77480]: DEBUG oslo_concurrency.lockutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Acquired lock "singleton_lock" {{(pid=77480) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:14:48 devstack cinder-volume[77480]: DEBUG oslo_concurrency.lockutils [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Releasing lock "singleton_lock" {{(pid=77480) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:14:48 devstack cinder-volume[77480]: WARNING amqp [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 23 03:14:48 devstack cinder-volume[77480]: WARNING amqp [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 23 03:14:48 devstack cinder-volume[77337]: INFO oslo_service.backend._eventlet.service [None req-df1dce49-004c-41a5-80e3-d168b3772e9f None None] Child 77480 exited with status 0
Jul 23 03:14:48 devstack cinder-volume[87579]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 23 03:14:48 devstack cinder-volume[87579]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 23 03:14:48 devstack cinder-volume[87579]: we strongly recommend against using it for new projects.
Jul 23 03:14:48 devstack cinder-volume[87579]: If you are already using Eventlet, we recommend migrating to a different
Jul 23 03:14:48 devstack cinder-volume[87579]: framework.  For more detail see
Jul 23 03:14:48 devstack cinder-volume[87579]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 23 03:14:48 devstack cinder-volume[87579]:   import eventlet  # noqa
Jul 23 03:14:50 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:14:50 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:14:50 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:14:51 devstack cinder-volume[87579]: INFO dbcounter [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Registered counter for database cinder
Jul 23 03:14:51 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:14:51 devstack cinder-volume[87579]: DEBUG dbcounter [-] [87579] Writer thread running {{(pid=87579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 23 03:14:51 devstack cinder-volume[87579]: INFO cinder.rpc [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 23 03:14:51 devstack cinder-volume[87579]: INFO cinder.rpc [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 23 03:14:51 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:14:52 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Determined volume DB was empty at startup.
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG cinder.volume.manager [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87579) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 23 03:14:52 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 23 03:14:52 devstack cinder-volume[87579]: WARNING stevedore.named [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 23 03:14:52 devstack cinder-volume[87579]: WARNING castellan.key_manager [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:14:52 devstack cinder-volume[87579]: WARNING cinder.keymgr.conf_key_mgr [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:14:52 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:14:52 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Starting 1 workers
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Started child 87793 {{(pid=87579) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Full set of CONF: {{(pid=87579) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] ******************************************************************************** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Configuration options gathered from: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] ================================================================================ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] allow_availability_zone_fallback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] allow_compression_on_image_upload = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] allowed_direct_url_schemes     = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] api_rate_limit                 = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] auth_strategy                  = keystone {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_availability_zone      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_host                   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_name                   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_stats_polling_interval = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backup_api_class               = cinder.backup.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backup_name_template           = backup-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backup_use_same_host           = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backup_use_temp_snapshot       = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] chap_password                  = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] chap_username                  =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87793]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_internal_tenant_project_id = ac2389517b354272b8890e660e03e112 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_internal_tenant_user_id = 21fa476fde1040bda589046d3f5c2ab8 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cluster                        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] compression_format             = gzip {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] config_dir                     = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] config_source                  = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] control_exchange               = openstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] debug                          = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] default_availability_zone      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] default_group_type             = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] default_volume_type            = QuobyteHD {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] disk_geometry                  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] driver_client_cert             = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] driver_client_cert_key         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] driver_data_namespace          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] driver_ssl_cert_path           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] driver_ssl_cert_verify         = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] driver_use_ssl                 = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] enable_new_services            = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] enable_unsupported_driver      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] enforce_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] filter_function                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_api_insecure            = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_api_servers             = ['http://192.168.122.85/image'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_api_ssl_compression     = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_ca_certificates_file    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_certfile                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_keyfile                 = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_num_retries             = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance_request_timeout         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] goodness_function              = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] graceful_shutdown_timeout      = 5 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] group_api_class                = cinder.group.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] host                           = devstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_compress_on_upload       = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_conversion_address_space_limit = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_conversion_cpu_limit     = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_conversion_disable       = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_upload_use_cinder_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_upload_use_internal_tenant = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_volume_cache_enabled     = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_volume_cache_max_count   = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] image_volume_cache_max_size_gb = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] init_host_max_objects_retrieval = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] iscsi_target_flags             =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] iscsi_write_cache              = on {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] iser_helper                    = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] iser_ip_address                = 192.168.122.85 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] iser_port                      = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_color                      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_config_append              = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_dir                        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_file                       = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_options                    = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_rotate_interval            = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_rotate_interval_type       = days {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] log_rotation_type              = none {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] max_age                        = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] max_logfile_count              = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] max_logfile_size_mb            = 200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] max_over_subscription_ratio    = 20.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] message_reap_interval          = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] message_ttl                    = 2592000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] migration_create_volume_timeout_secs = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] monkey_patch                   = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] monkey_patch_modules           = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] my_ip                          = 192.168.122.85 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] no_snapshot_gb_quota           = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] num_iser_scan_tries            = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] num_shell_tries                = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] num_volume_device_scan_tries   = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] nvmeof_conn_info_version       = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] nvmet_ns_id                    = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] nvmet_port_id                  = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_max_limit                = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_volume_ext_list          = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_volume_listen_port       = 8776 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_volume_use_ssl           = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] osapi_volume_workers           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] per_volume_size_limit          = -1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] periodic_fuzzy_delay           = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] periodic_interval              = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] public_endpoint                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] publish_errors                 = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_backup_gigabytes         = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_backups                  = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_gigabytes                = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_groups                   = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_snapshots                = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] quota_volumes                  = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] rate_limit_burst               = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] rate_limit_except_level        = CRITICAL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] rate_limit_interval            = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] reinit_driver_count            = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] replication_device             = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] report_discard_supported       = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] report_interval                = 120 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] reservation_clean_interval     = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] reservation_expire             = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] reserved_image_namespaces      = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] reserved_percentage            = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] rpc_response_timeout           = 120 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] run_external_periodic_tasks    = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] scst_target_driver             = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] scst_target_iqn_name           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_down_time              = 720 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] shell_completion               = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] snapshot_name_template         = snapshot-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] split_loggers                  = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] state_path                     = /opt/stack/data/cinder {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] storage_availability_zone      = nova {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] storage_protocol               = iSCSI {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] syslog_log_facility            = LOG_USER {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] target_helper                  = lioadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] target_ip_address              = 192.168.122.85 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] target_port                    = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] target_protocol                = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] target_secondary_ip_addresses  = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] trace_flags                    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] transport_url                  = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] until_refresh                  = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_chap_auth                  = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_default_quota_class        = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_journal                    = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_json                       = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_multipath_for_image_xfer   = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_stderr                     = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] use_syslog                     = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] verify_glance_signatures       = enabled {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_api_class               = cinder.volume.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_backend_name            = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_clear                   = zero {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_clear_ionice            = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_clear_size              = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_copy_bps_limit          = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_dd_blocksize            = 1M {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_name_template           = volume-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_service_inithost_offload = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volume_usage_audit_period      = month {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87793]: INFO cinder.volume.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Starting volume driver QuobyteDriver (1.2)
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] zoning_mode                    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_concurrency.disable_process_locking = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.remotefs [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87793) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.auth_type   = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.auth_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.cache       = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.certfile    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.include_service_catalog = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.insecure    = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.interface   = public {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.keyfile     = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_password =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcache_username =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.service_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.85/identity {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.backend                  = dogpile.cache.null {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.backend_argument         = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.backend_expiration_time  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.config_prefix            = cache.oslo {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.debug_cache_backend      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.enable_retry_client      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.enable_socket_keepalive  = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.enabled                  = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.expiration_time          = 600 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.hashclient_retry_attempts = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_dead_retry      = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_sasl_enabled    = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.password                 = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.proxies                  = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.redis_db                 = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.redis_server             = localhost:6379 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.retry_attempts           = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.retry_delay              = 0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.socket_keepalive_count   = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.socket_keepalive_idle    = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.socket_keepalive_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.socket_timeout           = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.tls_allowed_ciphers      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.tls_cafile               = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.tls_certfile             = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.tls_enabled              = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.tls_keyfile              = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cache.username                 = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] coordination.backend_url       = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.asyncio_connection    = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.asyncio_slave_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.backend               = sqlalchemy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.connection            = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.connection_debug      = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.connection_parameters =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.connection_recycle_time = 3600 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.connection_trace      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.db_inc_retry_interval = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.db_max_retries        = 20 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.db_max_retry_interval = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.db_retry_interval     = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.max_overflow          = 50 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.max_pool_size         = 5 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.max_retries           = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.mysql_wsrep_sync_wait = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.pool_timeout          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.retry_interval        = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.slave_connection      = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.sqlite_synchronous    = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.synchronous_reader    = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] database.use_db_reconnect      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.connection_string     = messaging:// {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.enabled               = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.es_doc_type           = notification {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.es_scroll_size        = 10000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.es_scroll_time        = 2m {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.filter_error_trace    = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.hmac_keys             = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.sentinel_service_name = mymaster {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.socket_timeout        = 0.1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.trace_requests        = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler.trace_sqlalchemy      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler_jaeger.process_tags   = {} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler_jaeger.service_name_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] profiler_otlp.service_name_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.enforce_new_defaults = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.policy_default_rule = default {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.group          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.helper_command = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] privsep_osbrick.user           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.group         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.helper_command = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] cinder_sys_admin.user          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.auth_section      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.auth_type         = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.cafile            = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.certfile          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.collect_timing    = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.insecure          = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.keyfile           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.send_service_user_token = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.split_loggers     = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] service_user.timeout           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.auth_section            = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.auth_type               = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.certfile                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.collect_timing          = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.insecure                = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.keyfile                 = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.region_name             = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.split_loggers           = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] glance.timeout                 = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.chap_username =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.driver_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.extra_capabilities = {} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.iscsi_target_flags =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.iscsi_write_cache = on {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.iser_port     = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_host      =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_login     = admin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_mount_options = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_password  = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_private_key =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_share_path =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.num_shell_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.quobyte_volume_url = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.report_discard_supported = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.reserved_percentage = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.target_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.target_port   = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.target_protocol = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.trace_flags   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.unique_fqdn_network = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.use_chap_auth = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_clear  = zero {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_clear_size = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_reports.file_event_handler = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_reports.log_dir           = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.backend_host         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.chap_password        = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.chap_username        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.disk_geometry        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.driver_client_cert   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.extra_capabilities   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.filter_function      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.goodness_function    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.iser_helper          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.iser_ip_address      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.iser_port            = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_host             = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_login            = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_mount_options    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_password         = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_private_key      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_share_path       = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.num_shell_tries      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.replication_device   = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.report_discard_supported = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.reserved_percentage  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.scst_target_driver   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.storage_protocol     = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.target_helper        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87793) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 23 03:14:52 devstack cinder-volume[87793]: WARNING cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 23 03:14:52 devstack cinder-volume[87793]: WARNING cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.target_ip_address    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.target_port          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.target_prefix        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.target_protocol      = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Running cmd (subprocess): mount.quobyte {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.trace_flags          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.use_chap_auth        = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_clear         = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_clear_size    = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] QuobyteHD.volumes_dir          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_notifications.driver = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_notifications.retry = -1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] key_manager.fixed_key          = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.barbican_api_version  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.barbican_endpoint     = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.barbican_endpoint_type = public {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.barbican_region_name  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.cafile                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.certfile              = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.collect_timing        = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.insecure              = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.keyfile               = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.number_of_retries     = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.retry_delay           = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.send_service_user_token = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.split_loggers         = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.timeout               = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.verify_ssl            = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican.verify_ssl_path       = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.auth_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.cafile   = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.keyfile  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] barbican_service_user.timeout  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.approle_role_id          = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.approle_secret_id        = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.auth_method              = approle {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.auth_path                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.kv_mountpoint            = secret {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.kv_path                  = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.kv_version               = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.namespace                = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.root_token_id            = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.ssl_ca_crt_file          = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.timeout                  = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.token_file               = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.token_role               = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.use_ssl                  = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:14:52 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] ******************************************************************************** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 23 03:14:52 devstack quobyte-client[87798]: Reading configuration file: /etc/quobyte/client.cfg
Jul 23 03:14:52 devstack quobyte-client[87798]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=87793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:14:52 devstack cinder-volume[87793]: INFO cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 ...
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 -c /etc/quobyte/client-cinder.cfg {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:14:52 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 -c /etc/quobyte/client-cinder.cfg
Jul 23 03:14:52 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:14:52 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Jul 23 03:14:52 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:52 devstack cinder-volume[87793]: INFO cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 succeeded
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=87793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.434s {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:14:53 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:14:53 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:14:53 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.260s {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:53 devstack cinder-volume[87793]: INFO cinder.volume.driver [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Driver hasn't implemented _init_vendor_properties()
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.volume.driver [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87793) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_db.sqlalchemy.engines [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG dbcounter [-] [87793] Writer thread running {{(pid=87793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.db.api [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Building query based on filter {{(pid=87793) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.image.image_utils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87793) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 23 03:14:53 devstack cinder-volume[87793]: INFO cinder.keymgr.migration [None req-cbec6213-054d-4916-9eb5-3b8f332c0f79 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=87793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=87793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:14:53 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:14:53 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:14:53 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.232s {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Notifying Schedulers of capabilities ... {{(pid=87793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:14:53 devstack cinder-volume[87793]: INFO cinder.volume.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Driver initialization completed successfully.
Jul 23 03:14:53 devstack cinder-volume[87793]: INFO cinder.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Initiating service 3 cleanup
Jul 23 03:14:53 devstack cinder-volume[87793]: INFO cinder.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Service 3 cleanup completed.
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.service [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Creating RPC server for service cinder-volume {{(pid=87793) start /opt/stack/cinder/cinder/service.py:231}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.service [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87793) start /opt/stack/cinder/cinder/service.py:237}}
Jul 23 03:14:53 devstack cinder-volume[87793]: INFO cinder.volume.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=87793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG cinder.volume.drivers.quobyte [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=87793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:14:53 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:14:53 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:14:53 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:14:54 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Jul 23 03:14:54 devstack cinder-volume[87793]: DEBUG oslo_concurrency.processutils [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.281s {{(pid=87793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:14:54 devstack cinder-volume[87793]: INFO cinder.volume.manager [None req-221154f2-b710-4a18-b23c-1404f3c9eb50 None None] Driver post RPC initialization completed successfully.
Jul 23 03:14:57 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Caught SIGTERM, stopping children
Jul 23 03:14:57 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Acquiring lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:14:57 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Acquired lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:14:57 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Releasing lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:14:57 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Stop services. {{(pid=87579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 23 03:14:57 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Killing children. {{(pid=87579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 23 03:14:57 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Waiting on 1 children to exit
Jul 23 03:14:57 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Acquiring lock "singleton_lock" {{(pid=87793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:14:57 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Acquired lock "singleton_lock" {{(pid=87793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:14:57 devstack cinder-volume[87793]: DEBUG oslo_concurrency.lockutils [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Releasing lock "singleton_lock" {{(pid=87793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:14:57 devstack cinder-volume[87793]: WARNING amqp [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 23 03:14:58 devstack cinder-volume[87793]: WARNING amqp [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 23 03:14:58 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-f8b9fe89-7d7f-4fb1-a11c-18526d0a4209 None None] Child 87793 exited with status 0
Jul 23 03:14:58 devstack cinder-volume[88065]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 23 03:14:58 devstack cinder-volume[88065]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 23 03:14:58 devstack cinder-volume[88065]: we strongly recommend against using it for new projects.
Jul 23 03:14:58 devstack cinder-volume[88065]: If you are already using Eventlet, we recommend migrating to a different
Jul 23 03:14:58 devstack cinder-volume[88065]: framework.  For more detail see
Jul 23 03:14:58 devstack cinder-volume[88065]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 23 03:14:58 devstack cinder-volume[88065]:   import eventlet  # noqa
Jul 23 03:15:01 devstack cinder-volume[88065]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 23 03:15:01 devstack cinder-volume[88065]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 23 03:15:01 devstack cinder-volume[88065]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 23 03:15:03 devstack cinder-volume[88065]: INFO dbcounter [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Registered counter for database cinder
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88065) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG dbcounter [-] [88065] Writer thread running {{(pid=88065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 23 03:15:03 devstack cinder-volume[88065]: INFO cinder.rpc [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 23 03:15:03 devstack cinder-volume[88065]: INFO cinder.rpc [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88065) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:15:03 devstack cinder-volume[88065]: INFO cinder.volume.manager [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Determined volume DB was empty at startup.
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG cinder.volume.manager [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88065) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 23 03:15:03 devstack cinder-volume[88065]: WARNING stevedore.named [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 23 03:15:03 devstack cinder-volume[88065]: WARNING castellan.key_manager [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:15:03 devstack cinder-volume[88065]: WARNING cinder.keymgr.conf_key_mgr [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 23 03:15:03 devstack cinder-volume[88065]: INFO cinder.volume.manager [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88065) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:15:03 devstack cinder-volume[88065]: INFO oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Starting 1 workers
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Started child 88344 {{(pid=88065) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Full set of CONF: {{(pid=88065) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] ******************************************************************************** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] Configuration options gathered from: {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] ================================================================================ {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] allow_availability_zone_fallback = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] allow_compression_on_image_upload = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88344]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] allowed_direct_url_schemes     = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] api_rate_limit                 = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] auth_strategy                  = keystone {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_availability_zone      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_host                   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_name                   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_stats_polling_interval = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backup_api_class               = cinder.backup.api.API {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backup_name_template           = backup-%s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backup_use_same_host           = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backup_use_temp_snapshot       = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] chap_password                  = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] chap_username                  =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_internal_tenant_project_id = ac2389517b354272b8890e660e03e112 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_internal_tenant_user_id = 21fa476fde1040bda589046d3f5c2ab8 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cluster                        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] compression_format             = gzip {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] compute_api_class              = cinder.compute.nova.API {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] config_dir                     = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:03 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] config_source                  = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] control_exchange               = openstack {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] debug                          = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] default_availability_zone      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] default_group_type             = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] default_volume_type            = QuobyteHD {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] disk_geometry                  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] driver_client_cert             = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] driver_client_cert_key         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] driver_data_namespace          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] driver_ssl_cert_path           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] driver_ssl_cert_verify         = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] driver_use_ssl                 = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] enable_new_services            = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] enable_unsupported_driver      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] enabled_backends               = ['QuobyteHD'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] enforce_multipath_for_image_xfer = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] filter_function                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_api_insecure            = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_api_servers             = ['http://192.168.122.85/image'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_api_ssl_compression     = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_ca_certificates_file    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_catalog_info            = image:glance:publicURL {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_certfile                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_keyfile                 = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_num_retries             = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance_request_timeout         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] goodness_function              = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] graceful_shutdown_timeout      = 5 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] group_api_class                = cinder.group.api.API {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] host                           = devstack {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_compress_on_upload       = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_conversion_address_space_limit = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_conversion_cpu_limit     = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_conversion_disable       = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_upload_use_cinder_backend = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_upload_use_internal_tenant = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_volume_cache_enabled     = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_volume_cache_max_count   = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] image_volume_cache_max_size_gb = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] init_host_max_objects_retrieval = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] instance_format                = [instance: %(uuid)s]  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] iscsi_target_flags             =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] iscsi_write_cache              = on {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] iser_helper                    = tgtadm {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Starting volume driver QuobyteDriver (1.2)
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88344) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] iser_ip_address                = 192.168.122.85 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] iser_port                      = 3260 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_color                      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_config_append              = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_dir                        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_file                       = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_options                    = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_rotate_interval            = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_rotate_interval_type       = days {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] log_rotation_type              = none {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] max_age                        = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] max_logfile_count              = 30 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] max_logfile_size_mb            = 200 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] max_over_subscription_ratio    = 20.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] message_reap_interval          = 86400 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] message_ttl                    = 2592000 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] migration_create_volume_timeout_secs = 300 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] monkey_patch                   = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] monkey_patch_modules           = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] my_ip                          = 192.168.122.85 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] no_snapshot_gb_quota           = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] num_iser_scan_tries            = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] num_shell_tries                = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] num_volume_device_scan_tries   = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] nvmeof_conn_info_version       = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] nvmet_ns_id                    = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] nvmet_port_id                  = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_max_limit                = 1000 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_volume_ext_list          = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_volume_listen_port       = 8776 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_volume_use_ssl           = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] osapi_volume_workers           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] per_volume_size_limit          = -1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] periodic_fuzzy_delay           = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] periodic_interval              = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] public_endpoint                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] publish_errors                 = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_backup_gigabytes         = 1000 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_backups                  = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_gigabytes                = 1000 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_groups                   = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_snapshots                = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] quota_volumes                  = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] rate_limit_burst               = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] rate_limit_except_level        = CRITICAL {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] rate_limit_interval            = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] reinit_driver_count            = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] replication_device             = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] report_discard_supported       = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] report_interval                = 120 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] reservation_clean_interval     = 86400 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] reservation_expire             = 86400 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] reserved_image_namespaces      = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] reserved_percentage            = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] rpc_response_timeout           = 120 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] run_external_periodic_tasks    = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] scst_target_driver             = iscsi {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] scst_target_iqn_name           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_down_time              = 720 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] shell_completion               = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] snapshot_name_template         = snapshot-%s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] split_loggers                  = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] state_path                     = /opt/stack/data/cinder {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] storage_availability_zone      = nova {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] storage_protocol               = iSCSI {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] syslog_log_facility            = LOG_USER {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] target_helper                  = lioadm {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] target_ip_address              = 192.168.122.85 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] target_port                    = 3260 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] target_protocol                = iscsi {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] target_secondary_ip_addresses  = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] trace_flags                    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] transport_url                  = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] until_refresh                  = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_chap_auth                  = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_default_quota_class        = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_journal                    = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_json                       = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_multipath_for_image_xfer   = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_stderr                     = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] use_syslog                     = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] verify_glance_signatures       = enabled {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_api_class               = cinder.volume.api.API {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_backend_name            = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_clear                   = zero {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_clear_ionice            = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_clear_size              = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_copy_bps_limit          = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_dd_blocksize            = 1M {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_name_template           = volume-%s {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_service_inithost_offload = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volume_usage_audit_period      = month {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] zoning_mode                    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_concurrency.disable_process_locking = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.auth_section = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.auth_type   = password {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.auth_version = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.cache       = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.certfile    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.delay_auth_decision = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.http_connect_timeout = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.include_service_catalog = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.insecure    = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.interface   = public {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.keyfile     = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_password =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcache_username =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.region_name = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88344) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 23 03:15:04 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.service_token_roles_required = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.service_type = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.token_cache_time = 300 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.85/identity {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.backend                  = dogpile.cache.null {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.backend_argument         = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.backend_expiration_time  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.config_prefix            = cache.oslo {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.debug_cache_backend      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.enable_retry_client      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.enable_socket_keepalive  = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.enabled                  = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Running cmd (subprocess): mount.quobyte {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.expiration_time          = 600 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.hashclient_retry_attempts = 2 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_dead_retry      = 300 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_pool_maxsize    = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_sasl_enabled    = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.password                 = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.proxies                  = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.redis_db                 = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.redis_sentinel_service_name = mymaster {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.redis_server             = localhost:6379 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.retry_attempts           = 2 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.retry_delay              = 0.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.socket_keepalive_count   = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.socket_keepalive_idle    = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.socket_keepalive_interval = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.socket_timeout           = 1.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.tls_allowed_ciphers      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.tls_cafile               = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.tls_certfile             = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.tls_enabled              = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.tls_keyfile              = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cache.username                 = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] coordination.backend_url       = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.asyncio_connection    = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.asyncio_slave_connection = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.backend               = sqlalchemy {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.connection            = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.connection_debug      = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.connection_parameters =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.connection_recycle_time = 3600 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.connection_trace      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.db_inc_retry_interval = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.db_max_retries        = 20 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.db_max_retry_interval = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.db_retry_interval     = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.max_overflow          = 50 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.max_pool_size         = 5 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.max_retries           = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.mysql_wsrep_sync_wait = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.pool_timeout          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.retry_interval        = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.slave_connection      = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.sqlite_synchronous    = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.synchronous_reader    = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] database.use_db_reconnect      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.connection_string     = messaging:// {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.enabled               = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.es_doc_type           = notification {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.es_scroll_size        = 10000 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.es_scroll_time        = 2m {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.filter_error_trace    = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.hmac_keys             = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.sentinel_service_name = mymaster {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.socket_timeout        = 0.1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.trace_requests        = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler.trace_sqlalchemy      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler_jaeger.process_tags   = {} {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler_jaeger.service_name_prefix = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] profiler_otlp.service_name_prefix = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.enforce_new_defaults = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.policy_default_rule = default {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.policy_file        = policy.yaml {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.group          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.helper_command = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] privsep_osbrick.user           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.group         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.helper_command = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] cinder_sys_admin.user          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.auth_section      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.auth_type         = password {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.cafile            = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.certfile          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.collect_timing    = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.insecure          = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.keyfile           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.send_service_user_token = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.split_loggers     = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] service_user.timeout           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.auth_section            = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.auth_type               = password {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.certfile                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.collect_timing          = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.insecure                = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.keyfile                 = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.region_name             = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.split_loggers           = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] glance.timeout                 = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.backend_availability_zone = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.chap_password = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.chap_username =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.disk_geometry = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.driver_client_cert = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.driver_client_cert_key = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.driver_data_namespace = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.driver_use_ssl = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.enable_unsupported_driver = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.extra_capabilities = {} {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.filter_function = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.goodness_function = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.iscsi_target_flags =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.iscsi_write_cache = on {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.iser_helper   = tgtadm {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.iser_port     = 3260 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_host      =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_login     = admin {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_mount_options = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_password  = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_private_key =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_share_path =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.num_shell_tries = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.nvmet_port_id = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_client_cfg = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.quobyte_volume_url = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.replication_device = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.report_discard_supported = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack quobyte-client[88345]: Reading configuration file: /etc/quobyte/client.cfg
Jul 23 03:15:04 devstack quobyte-client[88345]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.reserved_percentage = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.scst_target_driver = iscsi {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.scst_target_iqn_name = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.storage_protocol = iSCSI {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.target_helper = tgtadm {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.target_port   = 3260 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.target_protocol = iscsi {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.trace_flags   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.unique_fqdn_network = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.use_chap_auth = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_backend_name = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_clear  = zero {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_clear_ionice = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_clear_size = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_reports.file_event_handler = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_reports.log_dir           = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.backend_availability_zone = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.backend_host         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.chap_password        = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.chap_username        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.chiscsi_conf         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.disk_geometry        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.driver_client_cert   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.driver_client_cert_key = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.driver_data_namespace = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.driver_use_ssl       = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.extra_capabilities   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.filter_function      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.goodness_function    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.iser_helper          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.iser_ip_address      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.iser_port            = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.iser_target_prefix   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_host             = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_login            = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_mount_options    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_password         = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_private_key      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_share_path       = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_ssh_port         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.num_shell_tries      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.nvmet_port_id        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.replication_device   = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.report_discard_supported = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.reserved_percentage  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.scst_target_driver   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.storage_protocol     = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.target_helper        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.target_ip_address    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.target_port          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.target_prefix        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.target_protocol      = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.trace_flags          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.use_chap_auth        = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_clear         = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_clear_size    = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] QuobyteHD.volumes_dir          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:15:04 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl      = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_notifications.driver = [] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_notifications.retry = -1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] oslo_messaging_notifications.transport_url = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] key_manager.fixed_key          = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.barbican_api_version  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.barbican_endpoint     = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.barbican_endpoint_type = public {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.barbican_region_name  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.cafile                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.certfile              = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.collect_timing        = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.insecure              = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.keyfile               = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.number_of_retries     = 60 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.retry_delay           = 1 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.send_service_user_token = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.split_loggers         = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.timeout               = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.verify_ssl            = True {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican.verify_ssl_path       = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.auth_section = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.auth_type = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.cafile   = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.certfile = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.collect_timing = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.insecure = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.keyfile  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.split_loggers = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] barbican_service_user.timeout  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.approle_role_id          = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.approle_secret_id        = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.auth_method              = approle {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.auth_path                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.kv_mountpoint            = secret {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.kv_path                  = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.kv_version               = 2 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.namespace                = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.root_token_id            = **** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.ssl_ca_crt_file          = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.timeout                  = 60.0 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.token_file               = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.token_role               = None {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.use_ssl                  = False {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 23 03:15:04 devstack cinder-volume[88065]: DEBUG oslo_service.backend._eventlet.service [None req-2c7173b0-9ff0-4163-89ff-c77abf4f705f None None] ******************************************************************************** {{(pid=88065) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.352s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:15:04 devstack cinder-volume[88344]: INFO cinder.volume.driver [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Driver hasn't implemented _init_vendor_properties()
Jul 23 03:15:04 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.driver [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88344) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_db.sqlalchemy.engines [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writer thread running {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.db.api [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Building query based on filter {{(pid=88344) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88344) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:15:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:15:04 devstack cinder-volume[88344]: INFO cinder.keymgr.migration [None req-5c4934a8-c719-4b3d-a850-316b5b3b98aa None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 23 03:15:04 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:15:04 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:15:05 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.452s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:15:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Driver initialization completed successfully.
Jul 23 03:15:05 devstack cinder-volume[88344]: INFO cinder.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Initiating service 3 cleanup
Jul 23 03:15:05 devstack cinder-volume[88344]: INFO cinder.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Service 3 cleanup completed.
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG cinder.service [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Creating RPC server for service cinder-volume {{(pid=88344) start /opt/stack/cinder/cinder/service.py:231}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG cinder.service [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88344) start /opt/stack/cinder/cinder/service.py:237}}
Jul 23 03:15:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:15:05 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:15:05 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:15:05 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Jul 23 03:15:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:15:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-850c81c6-4117-4d21-93b7-44019ea75bb1 None None] Driver post RPC initialization completed successfully.
Jul 23 03:15:13 devstack cinder-volume[88065]: DEBUG dbcounter [-] [88065] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:15:15 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:15:15 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=4 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:15:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:15:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 6 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:15:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:16:19 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Flow 'volume_create_manager' (88c443b9-3263-486f-bf9c-ab7a3d6466b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f5abe7-c27a-4371-a368-9dbac66e7da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f5abe7-c27a-4371-a368-9dbac66e7da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741733626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6870952d-6cd3-4551-993d-cfb2cf14d119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2208d3e17bbe4c6082b4d17470e3fde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:16:20Z,use_quota=True,user_id='78a319fd5bb64c27bf500fc0f87500eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e6dfc9-edeb-4735-aa3f-387e0dc291a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e6dfc9-edeb-4735-aa3f-387e0dc291a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95b028-5379-472d-a516-aa59d44d0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95b028-5379-472d-a516-aa59d44d0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6870952d-6cd3-4551-993d-cfb2cf14d119', 'volume_name': 'volume-6870952d-6cd3-4551-993d-cfb2cf14d119', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db844052-d2d5-4663-aef9-0cf7edac4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db844052-d2d5-4663-aef9-0cf7edac4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53207b5-14db-4843-8fa8-b86e2a754c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:20 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Volume 6870952d-6cd3-4551-993d-cfb2cf14d119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6870952d-6cd3-4551-993d-cfb2cf14d119', 'volume_size': 1}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741733626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6870952d-6cd3-4551-993d-cfb2cf14d119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2208d3e17bbe4c6082b4d17470e3fde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:16:20Z,use_quota=True,user_id='78a319fd5bb64c27bf500fc0f87500eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Creating volume 6870952d-6cd3-4551-993d-cfb2cf14d119 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:16:20 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:16:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:20 devstack sudo[89175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119 1073741824
Jul 23 03:16:20 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:21 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119 1073741824" returned: 0 in 1.487s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:22 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119
Jul 23 03:16:22 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:22 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119" returned: 0 in 0.535s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53207b5-14db-4843-8fa8-b86e2a754c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6870952d-6cd3-4551-993d-cfb2cf14d119', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72523955-5d78-4812-906c-4795e39ff066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:22 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Volume volume-6870952d-6cd3-4551-993d-cfb2cf14d119 (6870952d-6cd3-4551-993d-cfb2cf14d119): created successfully
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72523955-5d78-4812-906c-4795e39ff066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Flow 'volume_create_manager' (88c443b9-3263-486f-bf9c-ab7a3d6466b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:16:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e6f548db-dc32-4b5c-8d95-c54aba6490af tempest-DeleteServersTestJSON-907388027 None] Created volume successfully.
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Flow 'volume_create_manager' (5d0ccf57-3af3-4a93-ac86-090356d5913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020e3ca3-d4a0-45be-a70f-de06499ec664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020e3ca3-d4a0-45be-a70f-de06499ec664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-551249698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04aa9747-84bb-4b74-bc6e-f0b1be1901df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1df5ae65c74ebe8fd772c875aa23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:16:30Z,use_quota=True,user_id='e7d49f0530534c14a8f1cc7f922e24d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362aa9bb-5b8a-4c37-8fd0-45079a3ed029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362aa9bb-5b8a-4c37-8fd0-45079a3ed029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17d55a4-b1d9-4b0f-8d56-d6c7bca8c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17d55a4-b1d9-4b0f-8d56-d6c7bca8c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04aa9747-84bb-4b74-bc6e-f0b1be1901df', 'volume_name': 'volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6cddae-e84b-4578-86fb-ddefeea26659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6cddae-e84b-4578-86fb-ddefeea26659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22630a53-fbf6-4bb6-9def-e33b1ad6c57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:30 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Volume 04aa9747-84bb-4b74-bc6e-f0b1be1901df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df', 'volume_size': 1}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-551249698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04aa9747-84bb-4b74-bc6e-f0b1be1901df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1df5ae65c74ebe8fd772c875aa23ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:16:30Z,use_quota=True,user_id='e7d49f0530534c14a8f1cc7f922e24d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Creating volume 04aa9747-84bb-4b74-bc6e-f0b1be1901df {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:16:30 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:16:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:30 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df 1073741824
Jul 23 03:16:30 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:31 devstack cinder-volume[88344]: WARNING py.warnings [req-4912df8b-68f9-430c-b4fb-a446c5e59028 req-720ffd93-e3cc-4507-ae50-98004a0e5284 tempest-DeleteServersTestJSON-907388027 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 23 03:16:31 devstack cinder-volume[88344]:   .first()
Jul 23 03:16:31 devstack cinder-volume[88344]: 
Jul 23 03:16:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-4912df8b-68f9-430c-b4fb-a446c5e59028 req-720ffd93-e3cc-4507-ae50-98004a0e5284 tempest-DeleteServersTestJSON-907388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:31 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df 1073741824" returned: 0 in 1.350s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:31 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df
Jul 23 03:16:31 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:32 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df" returned: 0 in 0.654s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-4912df8b-68f9-430c-b4fb-a446c5e59028 req-720ffd93-e3cc-4507-ae50-98004a0e5284 tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.325s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22630a53-fbf6-4bb6-9def-e33b1ad6c57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9983536-1a35-4df3-a471-6cd05d0647b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:32 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Volume volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df (04aa9747-84bb-4b74-bc6e-f0b1be1901df): created successfully
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9983536-1a35-4df3-a471-6cd05d0647b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Flow 'volume_create_manager' (5d0ccf57-3af3-4a93-ac86-090356d5913e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-4912df8b-68f9-430c-b4fb-a446c5e59028 req-720ffd93-e3cc-4507-ae50-98004a0e5284 tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.198s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-438cbcba-6632-4d9b-99de-900d1a13bfb9 tempest-ServerRescueNegativeTestJSON-296499049 None] Created volume successfully.
Jul 23 03:16:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-4912df8b-68f9-430c-b4fb-a446c5e59028 req-720ffd93-e3cc-4507-ae50-98004a0e5284 tempest-DeleteServersTestJSON-907388027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-6870952d-6cd3-4551-993d-cfb2cf14d119', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e45919a-e02c-4a6d-934e-4b17ed612f30', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:16:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-4912df8b-68f9-430c-b4fb-a446c5e59028 req-720ffd93-e3cc-4507-ae50-98004a0e5284 tempest-DeleteServersTestJSON-907388027 None] attachment_update completed successfully.
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Flow 'volume_create_manager' (34bcb956-407a-4b05-82a0-e4d1456460f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e3f17d-94ea-484d-a93a-22438591574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e3f17d-94ea-484d-a93a-22438591574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-372761272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02487d2-1898-486c-b734-eb9bf1a39513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdbc6600e8d442bb62d0c36e264e4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:16:37Z,use_quota=True,user_id='f591fa5e257d40d0ae7b24116134f4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e680a2-3f84-42da-8e08-45426f426560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e680a2-3f84-42da-8e08-45426f426560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe395e2-8aa5-4cb7-927e-0dca784c7a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe395e2-8aa5-4cb7-927e-0dca784c7a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02487d2-1898-486c-b734-eb9bf1a39513', 'volume_name': 'volume-f02487d2-1898-486c-b734-eb9bf1a39513', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc9f1b1-da5a-446b-94ad-4d0851933225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc9f1b1-da5a-446b-94ad-4d0851933225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec0e56a-5564-494e-b3a6-505e57a13772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:37 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Volume f02487d2-1898-486c-b734-eb9bf1a39513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02487d2-1898-486c-b734-eb9bf1a39513', 'volume_size': 1}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-372761272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02487d2-1898-486c-b734-eb9bf1a39513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdbc6600e8d442bb62d0c36e264e4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:16:37Z,use_quota=True,user_id='f591fa5e257d40d0ae7b24116134f4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Creating volume f02487d2-1898-486c-b734-eb9bf1a39513 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:16:37 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:16:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:37 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513 1073741824
Jul 23 03:16:37 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:39 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513 1073741824" returned: 0 in 1.551s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:39 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513
Jul 23 03:16:39 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:40 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513" returned: 0 in 0.597s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] <== create_volume: return (2365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec0e56a-5564-494e-b3a6-505e57a13772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02487d2-1898-486c-b734-eb9bf1a39513', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709c2e20-8cdb-450b-b93f-80bcf74cb783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:16:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Volume volume-f02487d2-1898-486c-b734-eb9bf1a39513 (f02487d2-1898-486c-b734-eb9bf1a39513): created successfully
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709c2e20-8cdb-450b-b93f-80bcf74cb783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:16:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Flow 'volume_create_manager' (34bcb956-407a-4b05-82a0-e4d1456460f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:16:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-80c4de7c-83b6-44e2-9dcb-6a81026ce0d0 tempest-VolumesAdminNegativeTest-2067097691 None] Created volume successfully.
Jul 23 03:16:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-fd1888f8-1732-4bb1-961c-4c5de7a53f5c req-9bfb02bc-a027-483e-9fa5-09a2066c50e0 tempest-DeleteServersTestJSON-907388027 None] Terminate volume connection completed successfully.
Jul 23 03:16:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-fd1888f8-1732-4bb1-961c-4c5de7a53f5c req-9bfb02bc-a027-483e-9fa5-09a2066c50e0 tempest-DeleteServersTestJSON-907388027 None] Deleting attachment 1e45919a-e02c-4a6d-934e-4b17ed612f30. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:16:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Acquiring lock "cinder-f02487d2-1898-486c-b734-eb9bf1a39513-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:16:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "cinder-f02487d2-1898-486c-b734-eb9bf1a39513-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:16:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Acquiring lock "cinder-quobyte-f02487d2-1898-486c-b734-eb9bf1a39513" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:16:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "cinder-quobyte-f02487d2-1898-486c-b734-eb9bf1a39513" acquired by "delete_volume" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:16:42 devstack cinder-volume[88344]: INFO oslo.privsep.daemon [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn9_h6jr6/privsep.sock']
Jul 23 03:16:42 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn9_h6jr6/privsep.sock
Jul 23 03:16:42 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 23 03:16:44 devstack cinder-volume[88344]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 23 03:16:45 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:45 devstack cinder-volume[88344]: INFO oslo.privsep.daemon [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Spawned new privsep daemon via rootwrap
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Accepted privsep connection to /tmp/tmpn9_h6jr6/privsep.sock {{(pid=88344) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 23 03:16:45 devstack cinder-volume[88344]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 23 03:16:45 devstack cinder-volume[88344]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 23 03:16:45 devstack cinder-volume[88344]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 23 03:16:45 devstack cinder-volume[88344]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90323
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a49cd-59db-45a4-b105-c0ed8c2cb282]: (2,) {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5ddc1e-8de8-4ae6-82a9-cbfa091fea90]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Acquiring lock "cinder-6870952d-6cd3-4551-993d-cfb2cf14d119-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Lock "cinder-6870952d-6cd3-4551-993d-cfb2cf14d119-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:16:45 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513
Jul 23 03:16:45 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Acquiring lock "cinder-quobyte-6870952d-6cd3-4551-993d-cfb2cf14d119" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Lock "cinder-quobyte-6870952d-6cd3-4551-993d-cfb2cf14d119" acquired by "delete_volume" :: waited 0.039s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9ee2df-c662-436b-bd36-5a08fbeecab5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:16:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:46 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119
Jul 23 03:16:46 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:46 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513" returned: 0 in 0.691s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:46 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513
Jul 23 03:16:46 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:46 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119" returned: 0 in 0.677s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:46 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119
Jul 23 03:16:46 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:46 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f02487d2-1898-486c-b734-eb9bf1a39513" returned: 0 in 0.495s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "cinder-quobyte-f02487d2-1898-486c-b734-eb9bf1a39513" released by "delete_volume" :: held 4.194s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:16:46 devstack cinder-volume[88344]: WARNING cinder.quota [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:16:46 devstack cinder-volume[88344]: WARNING cinder.quota [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:16:46 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Created reservations ['a5bab48b-0bbf-42ea-99b1-3f7bb94de20c', 'ff5b7649-b9f2-4f45-9692-2877aeb84dae', '356a8abd-ae05-4a41-978f-500eb1cb9c49', '9604b961-40bf-4bec-9c31-7772a51b11a6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:16:47 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6870952d-6cd3-4551-993d-cfb2cf14d119" returned: 0 in 0.442s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Lock "cinder-quobyte-6870952d-6cd3-4551-993d-cfb2cf14d119" released by "delete_volume" :: held 1.216s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:47 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:16:47 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Created reservations ['0969c144-0b63-4365-b918-52f6aca15b34', 'dd0fbf26-3345-4f8a-9347-3ebd031abd7e', 'bb073979-78e9-4206-be97-7f66c154a495', '5501e008-42c9-4f35-b254-8d1f7db0dea6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:47 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:16:47 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:47 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.717s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:16:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Deleted volume successfully.
Jul 23 03:16:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d27ea432-cb69-4213-b917-d31c4e7bf180 tempest-VolumesAdminNegativeTest-2067097691 None] Lock "cinder-f02487d2-1898-486c-b734-eb9bf1a39513-delete_volume" released by "delete_volume" :: held 5.510s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:16:48 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.517s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:48 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:16:48 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Deleted volume successfully.
Jul 23 03:16:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01c87153-b159-43d4-8c50-741f3ee7b0c0 tempest-DeleteServersTestJSON-907388027 None] Lock "cinder-6870952d-6cd3-4551-993d-cfb2cf14d119-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:16:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Acquiring lock "cinder-04aa9747-84bb-4b74-bc6e-f0b1be1901df-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:16:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "cinder-04aa9747-84bb-4b74-bc6e-f0b1be1901df-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:16:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Acquiring lock "cinder-quobyte-04aa9747-84bb-4b74-bc6e-f0b1be1901df" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:16:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "cinder-quobyte-04aa9747-84bb-4b74-bc6e-f0b1be1901df" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:16:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd74353c-f799-4056-9dcb-4db411afcf01]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:16:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:55 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df
Jul 23 03:16:55 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:56 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df" returned: 0 in 0.410s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:56 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df
Jul 23 03:16:56 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:56 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-04aa9747-84bb-4b74-bc6e-f0b1be1901df" returned: 0 in 0.464s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "cinder-quobyte-04aa9747-84bb-4b74-bc6e-f0b1be1901df" released by "delete_volume" :: held 0.927s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:16:56 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Created reservations ['4826ff2e-44d9-43b3-b18b-39af720af199', '0d883a45-bbce-42e7-91da-55ffd7fe7ff3', '991dd663-0ee9-4150-b43f-2d8b38dd7a87', '706315f4-d59b-4a38-9a83-b5549724723d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:57 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:16:57 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:57 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.359s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:16:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Deleted volume successfully.
Jul 23 03:16:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2c911a1-f06a-4cf9-96fa-3b6eb2362958 tempest-ServerRescueNegativeTestJSON-296499049 None] Lock "cinder-04aa9747-84bb-4b74-bc6e-f0b1be1901df-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:16:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:16:58 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:16:58 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:16:59 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Jul 23 03:16:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.574s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:16:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:16:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:16:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 8 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:16:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:17:15 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=27,cinder:UPDATE=37,cinder:DELETE=5,cinder:INSERT=6 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:17:15 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Flow 'volume_create_manager' (c5cebaab-212f-4692-9cff-4e7be593de4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97370655-6d39-4cc1-aa6c-3a09bcdd5e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97370655-6d39-4cc1-aa6c-3a09bcdd5e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-899090910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85b3e3d-8ea7-475d-a74d-9233885630ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba42a3cadc54619b32cac7ec96cc346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:38Z,use_quota=True,user_id='fb46c845be7a48d0ab031d17a91ddd69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453f834b-dc45-408c-9208-ae31e4e10219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453f834b-dc45-408c-9208-ae31e4e10219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19a49d5-9f6e-4961-8823-017b500bf5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19a49d5-9f6e-4961-8823-017b500bf5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85b3e3d-8ea7-475d-a74d-9233885630ba', 'volume_name': 'volume-f85b3e3d-8ea7-475d-a74d-9233885630ba', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b30677-cf7a-4f0a-ab3e-affeab0f50c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b30677-cf7a-4f0a-ab3e-affeab0f50c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0e65c6-d3e5-446b-b7fd-5a0de91a1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:17:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Volume f85b3e3d-8ea7-475d-a74d-9233885630ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85b3e3d-8ea7-475d-a74d-9233885630ba', 'volume_size': 1}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-899090910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85b3e3d-8ea7-475d-a74d-9233885630ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba42a3cadc54619b32cac7ec96cc346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:38Z,use_quota=True,user_id='fb46c845be7a48d0ab031d17a91ddd69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Creating volume f85b3e3d-8ea7-475d-a74d-9233885630ba {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:17:38 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:17:38 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba 1073741824
Jul 23 03:17:38 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:17:38 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba 1073741824" returned: 0 in 0.568s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:17:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:17:39 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba
Jul 23 03:17:39 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:17:39 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba" returned: 0 in 0.498s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0e65c6-d3e5-446b-b7fd-5a0de91a1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85b3e3d-8ea7-475d-a74d-9233885630ba', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a172e18-ad55-4029-ab04-8b8afdc9c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:17:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Volume volume-f85b3e3d-8ea7-475d-a74d-9233885630ba (f85b3e3d-8ea7-475d-a74d-9233885630ba): created successfully
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a172e18-ad55-4029-ab04-8b8afdc9c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:17:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Flow 'volume_create_manager' (c5cebaab-212f-4692-9cff-4e7be593de4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:17:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fbb40da8-7791-42b0-a5ea-cb0d818a93bd tempest-TaggedAttachmentsTest-1385395132 None] Created volume successfully.
Jul 23 03:17:49 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:17:49 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:17:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:17:58 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:17:58 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:17:59 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Jul 23 03:17:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.594s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:17:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Flow 'volume_create_manager' (598d0f46-cc04-43f1-af4c-e2145845eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f6956a-fe5f-48c5-8b5c-6035815ace99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f6956a-fe5f-48c5-8b5c-6035815ace99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-603926285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f1221c-6a00-4480-9c4d-8382a4146819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42816e85f5d042c098ffdf70ca5d073e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:00Z,use_quota=True,user_id='fd14ba87ee30425b82efe3a7384cac78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebef649c-2a62-4c5e-84bd-9bb5cc561f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebef649c-2a62-4c5e-84bd-9bb5cc561f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff76687-06f9-4cd9-8f1b-534514546374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff76687-06f9-4cd9-8f1b-534514546374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f1221c-6a00-4480-9c4d-8382a4146819', 'volume_name': 'volume-73f1221c-6a00-4480-9c4d-8382a4146819', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac41368-52a7-4b8f-9ee7-ee41bca3c0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac41368-52a7-4b8f-9ee7-ee41bca3c0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babdf436-4cd7-4769-bbaf-1c267b95ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:00 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Volume 73f1221c-6a00-4480-9c4d-8382a4146819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f1221c-6a00-4480-9c4d-8382a4146819', 'volume_size': 1}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-603926285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f1221c-6a00-4480-9c4d-8382a4146819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42816e85f5d042c098ffdf70ca5d073e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:00Z,use_quota=True,user_id='fd14ba87ee30425b82efe3a7384cac78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Creating volume 73f1221c-6a00-4480-9c4d-8382a4146819 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:18:00 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:18:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:00 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819 1073741824
Jul 23 03:18:00 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:01 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819 1073741824" returned: 0 in 0.826s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:01 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819
Jul 23 03:18:01 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:01 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819" returned: 0 in 0.478s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babdf436-4cd7-4769-bbaf-1c267b95ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f1221c-6a00-4480-9c4d-8382a4146819', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42c9f3f-fcfc-4766-84c8-86014437bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Volume volume-73f1221c-6a00-4480-9c4d-8382a4146819 (73f1221c-6a00-4480-9c4d-8382a4146819): created successfully
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42c9f3f-fcfc-4766-84c8-86014437bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Flow 'volume_create_manager' (598d0f46-cc04-43f1-af4c-e2145845eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-46691386-092d-4a9c-bc56-d0bad37bbc5c tempest-ServerActionsTestOtherA-1140704010 None] Created volume successfully.
Jul 23 03:18:11 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:18:11 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Flow 'volume_create_manager' (7aa92b29-caa3-44da-9b2d-fed0db509e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b9b45c-9cee-4865-a8b4-9b5c77928c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b9b45c-9cee-4865-a8b4-9b5c77928c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-967150027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adc8283-3c23-46aa-aad0-dfbe449c37ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d53f9f868d4e07afd5e0e719945b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:25Z,use_quota=True,user_id='0fd05353c113417abf4410bb96e1c9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233eeea5-2c4f-4462-ae04-081673228de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233eeea5-2c4f-4462-ae04-081673228de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cfbbff-d417-4df6-9761-edcb9e5a74cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cfbbff-d417-4df6-9761-edcb9e5a74cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3adc8283-3c23-46aa-aad0-dfbe449c37ac', 'volume_name': 'volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08c87da-8069-4d2b-9e24-39918f9f1af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08c87da-8069-4d2b-9e24-39918f9f1af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8952312e-2208-4838-a448-3e455cebdfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Volume 3adc8283-3c23-46aa-aad0-dfbe449c37ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac', 'volume_size': 1}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-967150027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adc8283-3c23-46aa-aad0-dfbe449c37ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d53f9f868d4e07afd5e0e719945b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:25Z,use_quota=True,user_id='0fd05353c113417abf4410bb96e1c9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Creating volume 3adc8283-3c23-46aa-aad0-dfbe449c37ac {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:18:25 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:18:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:25 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac 1073741824
Jul 23 03:18:25 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:26 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac 1073741824" returned: 0 in 1.004s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:26 devstack sudo[91398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac
Jul 23 03:18:26 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:26 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac" returned: 0 in 0.370s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8952312e-2208-4838-a448-3e455cebdfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87d1356-6965-4b06-b71b-78cb6fdb9a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Volume volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac (3adc8283-3c23-46aa-aad0-dfbe449c37ac): created successfully
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87d1356-6965-4b06-b71b-78cb6fdb9a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Flow 'volume_create_manager' (7aa92b29-caa3-44da-9b2d-fed0db509e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-010847a7-b08f-460d-b493-cf65ac6d17e2 tempest-ServersNegativeTestJSON-1756109710 None] Created volume successfully.
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Flow 'volume_create_manager' (e4a5b452-d9ce-4ab1-bbd7-0cb709270359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610d3ec7-789d-4cb4-ad23-441a5a752e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610d3ec7-789d-4cb4-ad23-441a5a752e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1430299439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d9cdf3-f65d-4896-82b8-fabdaa79137f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d53f9f868d4e07afd5e0e719945b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:29Z,use_quota=True,user_id='0fd05353c113417abf4410bb96e1c9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b343dc-3f67-4161-ac1c-22f633add0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b343dc-3f67-4161-ac1c-22f633add0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d174f8f-c371-4f53-b376-5f8597cd4939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d174f8f-c371-4f53-b376-5f8597cd4939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d9cdf3-f65d-4896-82b8-fabdaa79137f', 'volume_name': 'volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff55fb54-0800-4642-8b18-aad25a693a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff55fb54-0800-4642-8b18-aad25a693a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065eda80-5485-4684-bdb4-0a39124a1f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:28 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Volume a2d9cdf3-f65d-4896-82b8-fabdaa79137f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f', 'volume_size': 1}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1430299439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d9cdf3-f65d-4896-82b8-fabdaa79137f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d53f9f868d4e07afd5e0e719945b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:29Z,use_quota=True,user_id='0fd05353c113417abf4410bb96e1c9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Creating volume a2d9cdf3-f65d-4896-82b8-fabdaa79137f {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:18:28 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:18:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:28 devstack sudo[91430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f 1073741824
Jul 23 03:18:28 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:29 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f 1073741824" returned: 0 in 0.416s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:29 devstack sudo[91437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f
Jul 23 03:18:29 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:29 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f" returned: 0 in 0.255s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065eda80-5485-4684-bdb4-0a39124a1f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1775cf5-0023-48f7-ba91-fca4309bc982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:29 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Volume volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f (a2d9cdf3-f65d-4896-82b8-fabdaa79137f): created successfully
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1775cf5-0023-48f7-ba91-fca4309bc982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Flow 'volume_create_manager' (e4a5b452-d9ce-4ab1-bbd7-0cb709270359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:29 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3ae3bbc2-608f-43d2-979a-b9821d5b300d tempest-ServersNegativeTestJSON-1756109710 None] Created volume successfully.
Jul 23 03:18:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "cinder-a2d9cdf3-f65d-4896-82b8-fabdaa79137f-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:18:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-a2d9cdf3-f65d-4896-82b8-fabdaa79137f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:18:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "cinder-quobyte-a2d9cdf3-f65d-4896-82b8-fabdaa79137f" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:18:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-quobyte-a2d9cdf3-f65d-4896-82b8-fabdaa79137f" acquired by "delete_volume" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:18:31 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbe6431-79e7-40a3-8b05-7a4ac89ae201]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:18:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:32 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f
Jul 23 03:18:32 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:32 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f" returned: 0 in 0.550s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:32 devstack sudo[91508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f
Jul 23 03:18:32 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:32 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2d9cdf3-f65d-4896-82b8-fabdaa79137f" returned: 0 in 0.267s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-quobyte-a2d9cdf3-f65d-4896-82b8-fabdaa79137f" released by "delete_volume" :: held 0.892s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Created reservations ['73bc22a1-f108-42c6-a3e5-781626c56ad9', 'ca4f2e94-5e48-4667-98f1-6d61a6c608b7', '51e7f54b-0536-437e-9f02-53116a600c4a', 'c627b709-28d2-4041-a734-7ce7a9a7519d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "cinder-3adc8283-3c23-46aa-aad0-dfbe449c37ac-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:18:33 devstack sudo[91518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:18:33 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-3adc8283-3c23-46aa-aad0-dfbe449c37ac-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "cinder-quobyte-3adc8283-3c23-46aa-aad0-dfbe449c37ac" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-quobyte-3adc8283-3c23-46aa-aad0-dfbe449c37ac" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c1b09e-32bc-447d-b12e-7761f89a8039]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8fcb7715-326a-4df7-bf4d-b0496076b369 req-c9777ddd-62f1-4d4f-8b06-4c4251fbec05 tempest-TaggedAttachmentsTest-1385395132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8fcb7715-326a-4df7-bf4d-b0496076b369 req-c9777ddd-62f1-4d4f-8b06-4c4251fbec05 tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8fcb7715-326a-4df7-bf4d-b0496076b369 req-c9777ddd-62f1-4d4f-8b06-4c4251fbec05 tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8fcb7715-326a-4df7-bf4d-b0496076b369 req-c9777ddd-62f1-4d4f-8b06-4c4251fbec05 tempest-TaggedAttachmentsTest-1385395132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-f85b3e3d-8ea7-475d-a74d-9233885630ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c370623d-a6ca-42f6-98c9-6ee993320ff9', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:18:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-8fcb7715-326a-4df7-bf4d-b0496076b369 req-c9777ddd-62f1-4d4f-8b06-4c4251fbec05 tempest-TaggedAttachmentsTest-1385395132 None] attachment_update completed successfully.
Jul 23 03:18:33 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac
Jul 23 03:18:33 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:33 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.356s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:18:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Deleted volume successfully.
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f5bf474a-9c7c-4384-87fc-d72256623c9b tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-a2d9cdf3-f65d-4896-82b8-fabdaa79137f-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:18:33 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac" returned: 0 in 0.413s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:33 devstack sudo[91596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac
Jul 23 03:18:33 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:33 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3adc8283-3c23-46aa-aad0-dfbe449c37ac" returned: 0 in 0.255s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-quobyte-3adc8283-3c23-46aa-aad0-dfbe449c37ac" released by "delete_volume" :: held 0.758s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:18:33 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Created reservations ['415f8382-8aa2-4d7d-a333-2e834ea4d3a9', '16fad2d0-2f4f-4500-9b55-b002a651d920', 'a1586ac4-0253-483a-80d7-fecf1e8ea678', '7f03d395-6ec2-4895-8ce8-65e99b7e5f1d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:34 devstack sudo[91918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:18:34 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:34 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.360s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:18:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Deleted volume successfully.
Jul 23 03:18:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-16c8d1c0-cbf9-4698-b684-811b06e5fa5a tempest-ServersNegativeTestJSON-1756109710 None] Lock "cinder-3adc8283-3c23-46aa-aad0-dfbe449c37ac-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:18:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-9b7c47d5-d394-49b5-a65f-8d29f79df990 req-356762a9-552d-480b-a5a5-bc85f393e1bd tempest-TaggedAttachmentsTest-1385395132 None] Terminate volume connection completed successfully.
Jul 23 03:18:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-9b7c47d5-d394-49b5-a65f-8d29f79df990 req-356762a9-552d-480b-a5a5-bc85f393e1bd tempest-TaggedAttachmentsTest-1385395132 None] Deleting attachment c370623d-a6ca-42f6-98c9-6ee993320ff9. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Flow 'volume_create_manager' (ec545c21-6320-42e9-afa8-3b2d0209694a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf0c3b1-57b5-4218-aa0e-636858fad272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf0c3b1-57b5-4218-aa0e-636858fad272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703835778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ae84a-f9b9-456e-a010-b8617fd299d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b471b9836845148352b3ea7d1acaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:40Z,use_quota=True,user_id='157b75d17d074b55a47003e380d359ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d6f975-46b4-4eb5-96e9-473935d52375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d6f975-46b4-4eb5-96e9-473935d52375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fc599c-5b05-4ed5-b606-2c6749110717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fc599c-5b05-4ed5-b606-2c6749110717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5ae84a-f9b9-456e-a010-b8617fd299d5', 'volume_name': 'volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6e1241-bba3-432f-b816-d0a59636f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6e1241-bba3-432f-b816-d0a59636f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f525b4d-7e9e-4d9a-af5a-50cc984d7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Volume 7e5ae84a-f9b9-456e-a010-b8617fd299d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5', 'volume_size': 1}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-703835778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ae84a-f9b9-456e-a010-b8617fd299d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b471b9836845148352b3ea7d1acaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:40Z,use_quota=True,user_id='157b75d17d074b55a47003e380d359ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Creating volume 7e5ae84a-f9b9-456e-a010-b8617fd299d5 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:18:39 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:18:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:39 devstack sudo[92026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 1073741824
Jul 23 03:18:39 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:40 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 1073741824" returned: 0 in 0.461s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:40 devstack sudo[92033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5
Jul 23 03:18:40 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:40 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5" returned: 0 in 0.434s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f525b4d-7e9e-4d9a-af5a-50cc984d7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d057d4b3-a817-48a2-8e1c-452cab5678c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:18:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Volume volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 (7e5ae84a-f9b9-456e-a010-b8617fd299d5): created successfully
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d057d4b3-a817-48a2-8e1c-452cab5678c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:18:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Flow 'volume_create_manager' (ec545c21-6320-42e9-afa8-3b2d0209694a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:18:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-34696f69-a623-491e-9e30-3f3ae03ecd2d tempest-AttachVolumeNegativeTest-546448200 None] Created volume successfully.
Jul 23 03:18:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-188953a7-9112-4360-904a-938dd980b22e req-6438a0ff-ae0f-48d8-a71a-9ecd67c9abef tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-188953a7-9112-4360-904a-938dd980b22e req-6438a0ff-ae0f-48d8-a71a-9ecd67c9abef tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-188953a7-9112-4360-904a-938dd980b22e req-6438a0ff-ae0f-48d8-a71a-9ecd67c9abef tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-188953a7-9112-4360-904a-938dd980b22e req-6438a0ff-ae0f-48d8-a71a-9ecd67c9abef tempest-AttachVolumeNegativeTest-546448200 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66075c94-5605-4a7c-b24e-b4d44b3cd49f', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:18:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-188953a7-9112-4360-904a-938dd980b22e req-6438a0ff-ae0f-48d8-a71a-9ecd67c9abef tempest-AttachVolumeNegativeTest-546448200 None] attachment_update completed successfully.
Jul 23 03:18:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Acquiring lock "cinder-f85b3e3d-8ea7-475d-a74d-9233885630ba-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:18:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Lock "cinder-f85b3e3d-8ea7-475d-a74d-9233885630ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:18:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Acquiring lock "cinder-quobyte-f85b3e3d-8ea7-475d-a74d-9233885630ba" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:18:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Lock "cinder-quobyte-f85b3e3d-8ea7-475d-a74d-9233885630ba" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:18:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d4b088-46b4-410c-a15c-5393bb005201]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:18:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:49 devstack sudo[92481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba
Jul 23 03:18:49 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:50 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba" returned: 0 in 0.617s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:50 devstack sudo[92498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba
Jul 23 03:18:50 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-86350269-2c2b-4146-9b36-5257b1c5d1c0 req-e9ee68e0-7b42-44fb-9893-d99824c0a3bc tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-86350269-2c2b-4146-9b36-5257b1c5d1c0 req-e9ee68e0-7b42-44fb-9893-d99824c0a3bc tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-86350269-2c2b-4146-9b36-5257b1c5d1c0 req-e9ee68e0-7b42-44fb-9893-d99824c0a3bc tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-86350269-2c2b-4146-9b36-5257b1c5d1c0 req-e9ee68e0-7b42-44fb-9893-d99824c0a3bc tempest-ServerActionsTestOtherA-1140704010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-73f1221c-6a00-4480-9c4d-8382a4146819', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b8b49e4-c051-4ada-b72c-af75284703bf', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:18:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-86350269-2c2b-4146-9b36-5257b1c5d1c0 req-e9ee68e0-7b42-44fb-9893-d99824c0a3bc tempest-ServerActionsTestOtherA-1140704010 None] attachment_update completed successfully.
Jul 23 03:18:50 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f85b3e3d-8ea7-475d-a74d-9233885630ba" returned: 0 in 0.406s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Lock "cinder-quobyte-f85b3e3d-8ea7-475d-a74d-9233885630ba" released by "delete_volume" :: held 1.089s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Created reservations ['47114e4d-3139-4e3a-a355-a2bf7f44b05a', '858f740f-3ef2-48ab-b1db-9f1291dd6e12', '2f01ab5e-d795-4a28-b025-d67519acc986', '637852c2-8b86-4b38-a33f-348ed2b9cb38'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:50 devstack sudo[92506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:18:50 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:51 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.355s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:51 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:18:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Deleted volume successfully.
Jul 23 03:18:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-82cdd52e-a300-4d28-b558-d77a80a11e6c tempest-TaggedAttachmentsTest-1385395132 None] Lock "cinder-f85b3e3d-8ea7-475d-a74d-9233885630ba-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:18:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-9738b3cd-face-405b-8d6f-4c6d080680c0 tempest-ServerActionsTestOtherA-1140704010 None] Terminate volume connection completed successfully.
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-9738b3cd-face-405b-8d6f-4c6d080680c0 tempest-ServerActionsTestOtherA-1140704010 None] Deleting attachment 7b8b49e4-c051-4ada-b72c-af75284703bf. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:18:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:18:58 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:18:58 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:18:59 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Jul 23 03:18:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.521s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:18:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:18:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:18:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 8 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:18:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:19:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-c0edde20-12b9-4805-8f02-c93953e4cfd7 tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-c0edde20-12b9-4805-8f02-c93953e4cfd7 tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-c0edde20-12b9-4805-8f02-c93953e4cfd7 tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-c0edde20-12b9-4805-8f02-c93953e4cfd7 tempest-ServerActionsTestOtherA-1140704010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-73f1221c-6a00-4480-9c4d-8382a4146819', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5f44012-dc79-4953-9d41-aa499650e34c', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:19:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-c8e10f4a-5a9e-470e-9362-941d9fa51ba7 req-c0edde20-12b9-4805-8f02-c93953e4cfd7 tempest-ServerActionsTestOtherA-1140704010 None] attachment_update completed successfully.
Jul 23 03:19:10 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=48,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Flow 'volume_create_manager' (6722878f-2f3d-45ed-9994-701d2d93931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d144e24a-aef3-41bf-8bd8-79fd3fb892fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d144e24a-aef3-41bf-8bd8-79fd3fb892fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-76632197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d09733f-888f-4c35-9aaf-c09b99fcab80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22a42fcb5ca94df28c0593ffa49c08b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:15Z,use_quota=True,user_id='43c2af9d0686455d877bc0c4e822151d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c53f3f-b51c-4d62-916d-3ff6c2b7f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c53f3f-b51c-4d62-916d-3ff6c2b7f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccf9ccb-621d-489e-a9f0-3245280da244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccf9ccb-621d-489e-a9f0-3245280da244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d09733f-888f-4c35-9aaf-c09b99fcab80', 'volume_name': 'volume-8d09733f-888f-4c35-9aaf-c09b99fcab80', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f6f378-c26e-4a0b-9ca3-4c0fe360a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f6f378-c26e-4a0b-9ca3-4c0fe360a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0b973a-3cb1-4fff-83db-35665aa7ab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Volume 8d09733f-888f-4c35-9aaf-c09b99fcab80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d09733f-888f-4c35-9aaf-c09b99fcab80', 'volume_size': 1}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-76632197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d09733f-888f-4c35-9aaf-c09b99fcab80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22a42fcb5ca94df28c0593ffa49c08b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:15Z,use_quota=True,user_id='43c2af9d0686455d877bc0c4e822151d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Creating volume 8d09733f-888f-4c35-9aaf-c09b99fcab80 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:19:15 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:15 devstack sudo[92810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 1073741824
Jul 23 03:19:15 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:15 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 1073741824" returned: 0 in 0.620s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:15 devstack sudo[92819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80
Jul 23 03:19:15 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:16 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80" returned: 0 in 0.352s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0b973a-3cb1-4fff-83db-35665aa7ab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d09733f-888f-4c35-9aaf-c09b99fcab80', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38da2f02-7db1-48b6-83d4-d6a0023d04ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Volume volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 (8d09733f-888f-4c35-9aaf-c09b99fcab80): created successfully
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38da2f02-7db1-48b6-83d4-d6a0023d04ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Flow 'volume_create_manager' (6722878f-2f3d-45ed-9994-701d2d93931f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e7a90eb3-7833-40d9-a4bf-944a91b16a6e tempest-VolumesTestJSON-53465168 None] Created volume successfully.
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Flow 'volume_create_manager' (98bd56e8-080d-4eb6-a319-4529ee056635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b9cd5e-a6a0-45e0-a52f-f6bdcc16b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b9cd5e-a6a0-45e0-a52f-f6bdcc16b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1482453065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91545a93-429f-49cc-a0b9-7612548e2556,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22a42fcb5ca94df28c0593ffa49c08b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:18Z,use_quota=True,user_id='43c2af9d0686455d877bc0c4e822151d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c5a808-2fdc-4e8d-8ebe-05ae4a22ad2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c5a808-2fdc-4e8d-8ebe-05ae4a22ad2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00c40c3-ddc2-4e7e-9bb5-296e52d89b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00c40c3-ddc2-4e7e-9bb5-296e52d89b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91545a93-429f-49cc-a0b9-7612548e2556', 'volume_name': 'volume-91545a93-429f-49cc-a0b9-7612548e2556', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b415594-bfac-4014-bd66-557b3bcbb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b415594-bfac-4014-bd66-557b3bcbb211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79dbb81-c5da-4193-8004-c0ec0fe1d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:18 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Volume 91545a93-429f-49cc-a0b9-7612548e2556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91545a93-429f-49cc-a0b9-7612548e2556', 'volume_size': 1}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1482453065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91545a93-429f-49cc-a0b9-7612548e2556,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22a42fcb5ca94df28c0593ffa49c08b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:18Z,use_quota=True,user_id='43c2af9d0686455d877bc0c4e822151d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Creating volume 91545a93-429f-49cc-a0b9-7612548e2556 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:19:18 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:18 devstack sudo[92940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556 1073741824
Jul 23 03:19:18 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:18 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556 1073741824" returned: 0 in 0.437s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:19 devstack sudo[92946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556
Jul 23 03:19:19 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:19 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556" returned: 0 in 0.246s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79dbb81-c5da-4193-8004-c0ec0fe1d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91545a93-429f-49cc-a0b9-7612548e2556', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ef58a8-c5e7-41ca-8c09-25c54a434ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Volume volume-91545a93-429f-49cc-a0b9-7612548e2556 (91545a93-429f-49cc-a0b9-7612548e2556): created successfully
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ef58a8-c5e7-41ca-8c09-25c54a434ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Flow 'volume_create_manager' (98bd56e8-080d-4eb6-a319-4529ee056635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:19 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-73a3b6f0-07e5-4e25-84d8-23606b0dcecf tempest-VolumesTestJSON-53465168 None] Created volume successfully.
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Flow 'volume_create_manager' (ef5ee010-60c7-4200-b9ba-8b7b49e460f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808817d2-01ab-464b-8bfa-24f2c5fbee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808817d2-01ab-464b-8bfa-24f2c5fbee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-945797247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9162000-2409-4300-8b59-4bc931a9249b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22a42fcb5ca94df28c0593ffa49c08b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:21Z,use_quota=True,user_id='43c2af9d0686455d877bc0c4e822151d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed8afd5-d01c-465b-8d43-2513c221e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed8afd5-d01c-465b-8d43-2513c221e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25afc20c-9005-4652-b2f3-6dcb846b8072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25afc20c-9005-4652-b2f3-6dcb846b8072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9162000-2409-4300-8b59-4bc931a9249b', 'volume_name': 'volume-d9162000-2409-4300-8b59-4bc931a9249b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a43d7c-6521-4395-8784-d39101923eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a43d7c-6521-4395-8784-d39101923eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a3a06d-7dc9-423f-acbc-2f3b772c9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:21 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Volume d9162000-2409-4300-8b59-4bc931a9249b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9162000-2409-4300-8b59-4bc931a9249b', 'volume_size': 1}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-945797247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9162000-2409-4300-8b59-4bc931a9249b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22a42fcb5ca94df28c0593ffa49c08b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:21Z,use_quota=True,user_id='43c2af9d0686455d877bc0c4e822151d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Creating volume d9162000-2409-4300-8b59-4bc931a9249b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:19:21 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:21 devstack sudo[92976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b 1073741824
Jul 23 03:19:21 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:21 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b 1073741824" returned: 0 in 0.521s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:21 devstack sudo[92982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b
Jul 23 03:19:21 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:22 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=58,cinder:UPDATE=44,cinder:INSERT=8,cinder:DELETE=5 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a3a06d-7dc9-423f-acbc-2f3b772c9e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9162000-2409-4300-8b59-4bc931a9249b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc60060-c8f4-4c81-a01e-ec47a45c405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:22 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Volume volume-d9162000-2409-4300-8b59-4bc931a9249b (d9162000-2409-4300-8b59-4bc931a9249b): created successfully
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc60060-c8f4-4c81-a01e-ec47a45c405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Flow 'volume_create_manager' (ef5ee010-60c7-4200-b9ba-8b7b49e460f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b236df16-51da-4566-8c48-dbf0b2e83677 tempest-VolumesTestJSON-53465168 None] Created volume successfully.
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Acquiring lock "cinder-d9162000-2409-4300-8b59-4bc931a9249b-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Lock "cinder-d9162000-2409-4300-8b59-4bc931a9249b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Acquiring lock "cinder-quobyte-d9162000-2409-4300-8b59-4bc931a9249b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Lock "cinder-quobyte-d9162000-2409-4300-8b59-4bc931a9249b" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8522e-1e80-4684-8d4e-485927171b3c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:24 devstack sudo[92987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b
Jul 23 03:19:24 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:24 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b" returned: 0 in 0.382s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:24 devstack sudo[92992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b
Jul 23 03:19:24 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:24 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d9162000-2409-4300-8b59-4bc931a9249b" returned: 0 in 0.240s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Lock "cinder-quobyte-d9162000-2409-4300-8b59-4bc931a9249b" released by "delete_volume" :: held 0.669s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Created reservations ['c7b6e7a8-e111-47eb-a49e-de95b05466e2', 'bdad1401-37cb-4725-91ff-443f755970da', 'b385c5b5-1914-496f-9689-41c304773a66', 'adfd5006-8ba4-4f0a-8ba7-bd014e8c74f8'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:24 devstack sudo[92996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:19:24 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:25 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.272s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:19:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Deleted volume successfully.
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f26b3000-a478-42b0-953f-18c97caf7bfc tempest-VolumesTestJSON-53465168 None] Lock "cinder-d9162000-2409-4300-8b59-4bc931a9249b-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Acquiring lock "cinder-91545a93-429f-49cc-a0b9-7612548e2556-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Lock "cinder-91545a93-429f-49cc-a0b9-7612548e2556-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Acquiring lock "cinder-quobyte-91545a93-429f-49cc-a0b9-7612548e2556" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Lock "cinder-quobyte-91545a93-429f-49cc-a0b9-7612548e2556" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[061daf2c-7c06-47dc-9f42-135d3083cc32]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:25 devstack sudo[92999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556
Jul 23 03:19:25 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:25 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:25 devstack sudo[93004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556
Jul 23 03:19:25 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:25 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91545a93-429f-49cc-a0b9-7612548e2556" returned: 0 in 0.263s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Lock "cinder-quobyte-91545a93-429f-49cc-a0b9-7612548e2556" released by "delete_volume" :: held 0.672s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Created reservations ['7ba68eaf-9743-4048-936d-0fdc57b14982', '99cd54e0-d577-4dad-a724-b728269d00a3', '2ed8668a-e534-4f52-90fc-fc9616b37fb2', 'aa5079c9-f1b3-445e-b703-327a1dddf589'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:26 devstack sudo[93007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:19:26 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Acquiring lock "cinder-8d09733f-888f-4c35-9aaf-c09b99fcab80-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Lock "cinder-8d09733f-888f-4c35-9aaf-c09b99fcab80-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:26 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.323s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:19:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Deleted volume successfully.
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37a0f453-f90b-4e97-817a-1bb103cf3dfa tempest-VolumesTestJSON-53465168 None] Lock "cinder-91545a93-429f-49cc-a0b9-7612548e2556-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Acquiring lock "cinder-quobyte-8d09733f-888f-4c35-9aaf-c09b99fcab80" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Lock "cinder-quobyte-8d09733f-888f-4c35-9aaf-c09b99fcab80" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[376ff147-7e59-4672-948b-33110a1cfda6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:26 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80
Jul 23 03:19:26 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:27 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80" returned: 0 in 0.456s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:27 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80
Jul 23 03:19:27 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:27 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d09733f-888f-4c35-9aaf-c09b99fcab80" returned: 0 in 0.250s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Lock "cinder-quobyte-8d09733f-888f-4c35-9aaf-c09b99fcab80" released by "delete_volume" :: held 0.794s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Created reservations ['64efd660-37a2-4eec-a5ce-96db5dd6a5ec', '235a5a67-9a08-47e6-abe2-c865557f454e', '4c7d2c9f-05e6-482b-9504-1d0b8e8f8596', '3563d944-9022-4273-ad3b-6273ee67c1f2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:27 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:19:27 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:27 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:19:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Deleted volume successfully.
Jul 23 03:19:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a526eabd-909a-4667-b05e-5fbd40349a5d tempest-VolumesTestJSON-53465168 None] Lock "cinder-8d09733f-888f-4c35-9aaf-c09b99fcab80-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f2c242e4-257a-48bb-a9ed-111a6b3b241f tempest-BackendsCapabilitiesAdminTestsJSON-26898802 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88344) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 23 03:19:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-47894ae5-ce93-405f-a591-24d1ad42f96c req-11988516-4063-4ee0-a86c-dc4761d01927 tempest-ServerActionsTestOtherA-1140704010 None] Terminate volume connection completed successfully.
Jul 23 03:19:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-47894ae5-ce93-405f-a591-24d1ad42f96c req-11988516-4063-4ee0-a86c-dc4761d01927 tempest-ServerActionsTestOtherA-1140704010 None] Deleting attachment a5f44012-dc79-4953-9d41-aa499650e34c. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:19:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-01f689f7-bb76-4464-9aed-16807b9c36c7 tempest-BackendsCapabilitiesAdminTestsJSON-26898802 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88344) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 23 03:19:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-53fe2be3-96e2-4769-83e5-c47d6f714213 req-c3f11508-ec39-4740-ba16-d0e856331e8b tempest-AttachVolumeNegativeTest-546448200 None] Terminate volume connection completed successfully.
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-53fe2be3-96e2-4769-83e5-c47d6f714213 req-c3f11508-ec39-4740-ba16-d0e856331e8b tempest-AttachVolumeNegativeTest-546448200 None] Deleting attachment 66075c94-5605-4a7c-b24e-b4d44b3cd49f. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "cinder-73f1221c-6a00-4480-9c4d-8382a4146819-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Lock "cinder-73f1221c-6a00-4480-9c4d-8382a4146819-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "cinder-quobyte-73f1221c-6a00-4480-9c4d-8382a4146819" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Lock "cinder-quobyte-73f1221c-6a00-4480-9c4d-8382a4146819" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[27281f2e-d296-4d57-9212-18f9387bdb4e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:37 devstack sudo[93158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819
Jul 23 03:19:37 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:37 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819" returned: 0 in 0.389s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:37 devstack sudo[93164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819
Jul 23 03:19:37 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:38 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-73f1221c-6a00-4480-9c4d-8382a4146819" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Lock "cinder-quobyte-73f1221c-6a00-4480-9c4d-8382a4146819" released by "delete_volume" :: held 0.731s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Created reservations ['ac83340f-384d-45b7-8ebf-b0416f04275b', 'f80400c1-f9e6-470d-8f5d-60fc5951dea9', '484c763a-fae3-450e-a721-3f3c58fc555e', 'a6338f25-58a6-4779-baa0-16c53b03c7c5'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:38 devstack sudo[93179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:19:38 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:38 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.452s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:19:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Deleted volume successfully.
Jul 23 03:19:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a25cde5a-8d4c-45a1-9ee5-792fcdebec76 tempest-ServerActionsTestOtherA-1140704010 None] Lock "cinder-73f1221c-6a00-4480-9c4d-8382a4146819-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b6cfa29-170f-40dc-bd56-03db576e1b08 tempest-GroupSnapshotsTest-801124300 None] Group tempest-GroupSnapshotsTest-Group-891250002: creating
Jul 23 03:19:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b6cfa29-170f-40dc-bd56-03db576e1b08 tempest-GroupSnapshotsTest-801124300 None] Group tempest-GroupSnapshotsTest-Group-891250002: created successfully
Jul 23 03:19:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b6cfa29-170f-40dc-bd56-03db576e1b08 tempest-GroupSnapshotsTest-801124300 None] Create group completed successfully.
Jul 23 03:19:41 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:19:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (49b83583-32bf-4fd6-a38d-2d33a969bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b25fb12-2e1d-42f4-9c28-f72247e9b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b25fb12-2e1d-42f4-9c28-f72247e9b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381646197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6d17deaa-36a6-4a4b-9ecb-7de5558c613c,host='devstack@QuobyteHD#QuobyteHD',id=fe0e1df6-4dd5-464d-a0fc-8df783df491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:42Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e9a82d4-8b3b-431d-a907-2fd68fc807b1),volume_type_id=1e9a82d4-8b3b-431d-a907-2fd68fc807b1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d8499a-2944-493b-a959-c892050e16ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d8499a-2944-493b-a959-c892050e16ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6f2d7f-1f0d-4c8b-8780-7ae8088fd63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6f2d7f-1f0d-4c8b-8780-7ae8088fd63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0e1df6-4dd5-464d-a0fc-8df783df491b', 'volume_name': 'volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ee01dd-4d16-4ebb-92dd-b1359f650072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ee01dd-4d16-4ebb-92dd-b1359f650072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3298bad-4f66-4015-8d95-d4204ff574a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Volume fe0e1df6-4dd5-464d-a0fc-8df783df491b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b', 'volume_size': 1}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6d17deaa-36a6-4a4b-9ecb-7de5558c613c,created_at=2026-07-23T01:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381646197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6d17deaa-36a6-4a4b-9ecb-7de5558c613c,host='devstack@QuobyteHD#QuobyteHD',id=fe0e1df6-4dd5-464d-a0fc-8df783df491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:42Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e9a82d4-8b3b-431d-a907-2fd68fc807b1),volume_type_id=1e9a82d4-8b3b-431d-a907-2fd68fc807b1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Creating volume fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:19:42 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:42 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b 1073741824
Jul 23 03:19:42 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:42 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b 1073741824" returned: 0 in 0.604s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:42 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:19:42 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:43 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 0.380s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3298bad-4f66-4015-8d95-d4204ff574a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150e831e-12c0-465f-af07-4e038c05a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Volume volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b (fe0e1df6-4dd5-464d-a0fc-8df783df491b): created successfully
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150e831e-12c0-465f-af07-4e038c05a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (49b83583-32bf-4fd6-a38d-2d33a969bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Flow 'volume_create_manager' (e56d4d35-e057-4f20-9f09-41dce1f62a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e015b5d7-7f79-437a-a21a-9151c7d84f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e015b5d7-7f79-437a-a21a-9151c7d84f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1322408513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0c7497-1bf0-43b6-bf1f-37eb021df6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5633c3b19d64cbda3e49725907ff3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:43Z,use_quota=True,user_id='d1e5d4e5bfe54da696597f3df1a55584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01282447-9987-4475-b5ce-eaf7090e5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01282447-9987-4475-b5ce-eaf7090e5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23af73b-1668-4e49-b848-133e4b352156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23af73b-1668-4e49-b848-133e4b352156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0c7497-1bf0-43b6-bf1f-37eb021df6e8', 'volume_name': 'volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3abf9b-b84c-4c74-9bcb-401d264ecb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3abf9b-b84c-4c74-9bcb-401d264ecb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2598a48e-9d66-4fa7-88c5-856caaa39bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Volume 4f0c7497-1bf0-43b6-bf1f-37eb021df6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8', 'volume_size': 1}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1322408513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0c7497-1bf0-43b6-bf1f-37eb021df6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5633c3b19d64cbda3e49725907ff3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:43Z,use_quota=True,user_id='d1e5d4e5bfe54da696597f3df1a55584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Creating volume 4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:19:43 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b9da6ba4-0b92-45ed-a32a-f0dc29c9dfb1 tempest-GroupSnapshotsTest-801124300 None] Created volume successfully.
Jul 23 03:19:43 devstack sudo[93238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 1073741824
Jul 23 03:19:43 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:43 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 1073741824" returned: 0 in 0.518s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:43 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8
Jul 23 03:19:43 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:44 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2598a48e-9d66-4fa7-88c5-856caaa39bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071217bb-8a79-453e-87b5-0833043d1e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:19:44 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Volume volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 (4f0c7497-1bf0-43b6-bf1f-37eb021df6e8): created successfully
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071217bb-8a79-453e-87b5-0833043d1e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Flow 'volume_create_manager' (e56d4d35-e057-4f20-9f09-41dce1f62a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:19:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-edb5c1c7-c01b-40d7-9c48-bf881a9d0800 tempest-AttachVolumeTestJSON-902404587 None] Created volume successfully.
Jul 23 03:19:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] GroupSnapshot 404bc2bd-bc81-47ed-ba90-203c5da879fd: creating.
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Group snapshot 404bc2bd-bc81-47ed-ba90-203c5da879fd: creating. {{(pid=88344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Creating offline snapshot 88cdd845-37e3-4c32-b9db-17d1cf997a7c of volume fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d956cc37-4db5-4e36-ad85-3f1711c9d579]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:45 devstack sudo[93248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:19:45 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:45 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 0.413s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:45 devstack sudo[93253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c 1G
Jul 23 03:19:45 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:46 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c 1G" returned: 0 in 0.663s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:46 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c
Jul 23 03:19:46 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-13af1f4f-1528-4fbc-8466-1f62ace285bd req-ab548c15-fd49-4ffd-ab44-704b825727ff tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:46 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c" returned: 0 in 0.355s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:46 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:46 devstack sudo[93280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c
Jul 23 03:19:46 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:46 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c" returned: 0 in 0.254s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:46 devstack sudo[93283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info
Jul 23 03:19:46 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:47 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info" returned: 0 in 0.342s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:47 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:47 devstack sudo[93286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info
Jul 23 03:19:47 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:47 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.info" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-13af1f4f-1528-4fbc-8466-1f62ace285bd req-ab548c15-fd49-4ffd-ab44-704b825727ff tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.212s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-13af1f4f-1528-4fbc-8466-1f62ace285bd req-ab548c15-fd49-4ffd-ab44-704b825727ff tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-13af1f4f-1528-4fbc-8466-1f62ace285bd req-ab548c15-fd49-4ffd-ab44-704b825727ff tempest-AttachVolumeTestJSON-902404587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13e04bdd-c6e3-452e-b63d-efe808f0ffb9', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:19:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b655d229-5b8c-4bfe-9ddf-49cf055547c1 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 404bc2bd-bc81-47ed-ba90-203c5da879fd: created successfully
Jul 23 03:19:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-13af1f4f-1528-4fbc-8466-1f62ace285bd req-ab548c15-fd49-4ffd-ab44-704b825727ff tempest-AttachVolumeTestJSON-902404587 None] attachment_update completed successfully.
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-88cdd845-37e3-4c32-b9db-17d1cf997a7c-000c6669-14c1-4d4f-9e6f-89d282f3f850" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-88cdd845-37e3-4c32-b9db-17d1cf997a7c-000c6669-14c1-4d4f-9e6f-89d282f3f850" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Creating volume 000c6669-14c1-4d4f-9e6f-89d282f3f850 from snapshot 88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-000c6669-14c1-4d4f-9e6f-89d282f3f850" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-000c6669-14c1-4d4f-9e6f-89d282f3f850" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] snapshot: 88cdd845-37e3-4c32-b9db-17d1cf997a7c, volume: 000c6669-14c1-4d4f-9e6f-89d282f3f850,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a59f5-6c60-4c3e-8778-a9266304c935]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:49 devstack sudo[93690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c
Jul 23 03:19:49 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:50 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c" returned: 0 in 0.560s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dcea00-f79c-49b7-89cc-f37616fae822]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:50 devstack sudo[93712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:19:50 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:50 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 0.540s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:19:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:50 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850
Jul 23 03:19:50 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:56 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850" returned: 0 in 5.636s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:56 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26a7596-7074-43ff-96d1-c937db0c3525]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:19:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:56 devstack sudo[93751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:19:56 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:57 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 1.085s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:57 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:19:57 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Converted 1024.00 MB image at 181.63 MB/s
Jul 23 03:19:57 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:19:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:57 devstack sudo[93877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850
Jul 23 03:19:57 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:58 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850" returned: 0 in 0.557s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-000c6669-14c1-4d4f-9e6f-89d282f3f850" released by "_copy_volume_from_snapshot" :: held 8.568s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-88cdd845-37e3-4c32-b9db-17d1cf997a7c-000c6669-14c1-4d4f-9e6f-89d282f3f850" released by "_create_volume_from_snapshot" :: held 8.645s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.689s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-451d893d-c994-41d0-8db3-fa91409ff0fe tempest-GroupSnapshotsTest-801124300 None] Create group from source-snapshot-404bc2bd-bc81-47ed-ba90-203c5da879fd completed successfully.
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:19:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:19:58 devstack sudo[93944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:19:58 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:19:59 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root
Jul 23 03:19:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.534s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:19:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:19:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:19:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 8 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:19:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:19:59 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-000c6669-14c1-4d4f-9e6f-89d282f3f850" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-000c6669-14c1-4d4f-9e6f-89d282f3f850" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac757247-16de-479f-abe4-729d7efb907c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:00 devstack sudo[94307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850
Jul 23 03:20:00 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:00 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850" returned: 0 in 0.596s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:00 devstack sudo[94336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850
Jul 23 03:20:00 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:00 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-000c6669-14c1-4d4f-9e6f-89d282f3f850" returned: 0 in 0.304s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-000c6669-14c1-4d4f-9e6f-89d282f3f850" released by "delete_volume" :: held 0.968s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['eae1daae-3543-4aa4-bcea-0d51e72a5166'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:01 devstack cinder-volume[88344]: WARNING cinder.quota [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1484801448 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1484801448, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:01 devstack cinder-volume[88344]: WARNING cinder.quota [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1484801448 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1484801448, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['c65f3ae5-762a-4b15-99d6-59a45aa824cd', 'd8d7e112-04e1-4714-ae4b-d02e9bdcdf4a', 'b8059589-b791-46a3-879e-0af9ea36fd2c', 'e071694b-59e0-4d80-a23a-47b68c862805'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:01 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:20:01 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:01 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.332s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:01 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:20:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4be7d392-f075-4b92-9525-ad4172952a32 tempest-GroupSnapshotsTest-801124300 None] Delete group completed successfully.
Jul 23 03:20:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 404bc2bd-bc81-47ed-ba90-203c5da879fd: deleting
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 404bc2bd-bc81-47ed-ba90-203c5da879fd: deleting {{(pid=88344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-fe0e1df6-4dd5-464d-a0fc-8df783df491b" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-fe0e1df6-4dd5-464d-a0fc-8df783df491b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-88cdd845-37e3-4c32-b9db-17d1cf997a7c" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-88cdd845-37e3-4c32-b9db-17d1cf997a7c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Deleting offline snapshot 88cdd845-37e3-4c32-b9db-17d1cf997a7c of volume fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] snapshot_file for this snap is: volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1d9ada-b576-46ce-846b-c1202cb7f3dc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:03 devstack sudo[94371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c
Jul 23 03:20:03 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:03 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c" returned: 0 in 0.690s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:20:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f8edd-aec0-4c21-ab65-1b1c3d31c8cc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:03 devstack sudo[94377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:20:03 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:04 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 0.988s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:04 devstack sudo[94388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c
Jul 23 03:20:04 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:05 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c" returned: 0 in 0.949s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:05 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c
Jul 23 03:20:05 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:06 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b.88cdd845-37e3-4c32-b9db-17d1cf997a7c" returned: 0 in 0.460s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-88cdd845-37e3-4c32-b9db-17d1cf997a7c" released by "_delete_snapshot" :: held 3.316s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-fe0e1df6-4dd5-464d-a0fc-8df783df491b" released by "delete_snapshot" :: held 3.369s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:06 devstack cinder-volume[88344]: WARNING cinder.quota [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1484801448 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1484801448, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:06 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['607bbdf7-2e76-4bc4-8b6d-04b78e92c7fe', '1722f1d0-18df-4450-bc5a-dd5b9025f1af', '602614df-d08c-487c-b525-c9031ebdcea2', 'eb3fc949-1c1e-4cf1-97fd-eb34e17dc292'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:06 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-aea32f34-95a7-4258-8a64-9d00e602aed8 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 404bc2bd-bc81-47ed-ba90-203c5da879fd: deleted successfully
Jul 23 03:20:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-fe0e1df6-4dd5-464d-a0fc-8df783df491b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-fe0e1df6-4dd5-464d-a0fc-8df783df491b" acquired by "delete_volume" :: waited 0.054s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:07 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856fe00-46aa-477a-bbca-72f0ce49f736]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:07 devstack sudo[94415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:20:07 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:07 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 0.546s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:07 devstack sudo[94420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b
Jul 23 03:20:07 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:08 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe0e1df6-4dd5-464d-a0fc-8df783df491b" returned: 0 in 0.526s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-fe0e1df6-4dd5-464d-a0fc-8df783df491b" released by "delete_volume" :: held 1.211s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['d78a8af2-27cc-49da-b87c-f40cc7d4d66d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:08 devstack cinder-volume[88344]: WARNING cinder.db.api [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1484801448']
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['94bbb0da-a8dc-4dc0-96c0-51bd86609622', '47074667-c5ee-4c5b-803f-54598a530bd3', '5377a1b0-7631-4c10-adaa-f9c8135a8213', '09f079b6-c86e-403e-9e13-1eb93c842b66'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:08 devstack sudo[94423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:20:08 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:09 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:09 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:20:09 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a7a94600-0388-4148-9bb7-37b259dc3bf9 tempest-GroupSnapshotsTest-801124300 None] Delete group completed successfully.
Jul 23 03:20:10 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=79,cinder:SELECT=77,cinder:INSERT=19,cinder:DELETE=5 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:20:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0fb33355-32f9-4eac-97db-be5ed52cdc57 tempest-GroupSnapshotsTest-801124300 None] Group tempest-GroupSnapshotsTest-Group-974892495: creating
Jul 23 03:20:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0fb33355-32f9-4eac-97db-be5ed52cdc57 tempest-GroupSnapshotsTest-801124300 None] Group tempest-GroupSnapshotsTest-Group-974892495: created successfully
Jul 23 03:20:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0fb33355-32f9-4eac-97db-be5ed52cdc57 tempest-GroupSnapshotsTest-801124300 None] Create group completed successfully.
Jul 23 03:20:12 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:20:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (2dcca976-bd3a-4cf2-96d2-d66cc60ec5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946732e3-b692-4c46-9845-8ff5f484fc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946732e3-b692-4c46-9845-8ff5f484fc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-857436343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f02a963-9517-41a5-90de-7e63b23064ce,host='devstack@QuobyteHD#QuobyteHD',id=5095eaff-317d-4646-99a3-c9b674d3c92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:13Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb4dd547-40a4-4450-8c29-9fd1ce14a8b0),volume_type_id=cb4dd547-40a4-4450-8c29-9fd1ce14a8b0)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112ffdcc-3f8a-427e-85ca-0384c67d8308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112ffdcc-3f8a-427e-85ca-0384c67d8308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424c6f20-4923-451b-946c-97a8948a9931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424c6f20-4923-451b-946c-97a8948a9931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5095eaff-317d-4646-99a3-c9b674d3c92b', 'volume_name': 'volume-5095eaff-317d-4646-99a3-c9b674d3c92b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602f276-0773-4efa-b39f-6b417860d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602f276-0773-4efa-b39f-6b417860d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2293e858-b260-404d-857f-7ba7208ebf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:13 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Volume 5095eaff-317d-4646-99a3-c9b674d3c92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5095eaff-317d-4646-99a3-c9b674d3c92b', 'volume_size': 1}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f02a963-9517-41a5-90de-7e63b23064ce,created_at=2026-07-23T01:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-857436343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f02a963-9517-41a5-90de-7e63b23064ce,host='devstack@QuobyteHD#QuobyteHD',id=5095eaff-317d-4646-99a3-c9b674d3c92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:13Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb4dd547-40a4-4450-8c29-9fd1ce14a8b0),volume_type_id=cb4dd547-40a4-4450-8c29-9fd1ce14a8b0)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Creating volume 5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:20:13 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:13 devstack sudo[94426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b 1073741824
Jul 23 03:20:13 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:13 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b 1073741824" returned: 0 in 0.599s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:13 devstack sudo[94431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b
Jul 23 03:20:13 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:13 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b" returned: 0 in 0.252s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:20:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2293e858-b260-404d-857f-7ba7208ebf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5095eaff-317d-4646-99a3-c9b674d3c92b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f851c80-e0c4-4ec7-8ef1-d8c1a75e75e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:14 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Volume volume-5095eaff-317d-4646-99a3-c9b674d3c92b (5095eaff-317d-4646-99a3-c9b674d3c92b): created successfully
Jul 23 03:20:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f851c80-e0c4-4ec7-8ef1-d8c1a75e75e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (2dcca976-bd3a-4cf2-96d2-d66cc60ec5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e536b65-d662-4d0e-bc6e-8ed92d9d4273 tempest-GroupSnapshotsTest-801124300 None] Created volume successfully.
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (9e619dbc-40d3-49b4-9274-ca75933472d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e21e58c-dc55-4861-a500-de32e715e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e21e58c-dc55-4861-a500-de32e715e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343514300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f02a963-9517-41a5-90de-7e63b23064ce,host='devstack@QuobyteHD#QuobyteHD',id=e9b564b7-971c-4524-8bcc-158e9c1b3474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:15Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb4dd547-40a4-4450-8c29-9fd1ce14a8b0),volume_type_id=cb4dd547-40a4-4450-8c29-9fd1ce14a8b0)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8805ec9-8ef3-4fb3-ad81-8faeff52e6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8805ec9-8ef3-4fb3-ad81-8faeff52e6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfb662f-eeaf-4156-81a6-ef4cea649a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfb662f-eeaf-4156-81a6-ef4cea649a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b564b7-971c-4524-8bcc-158e9c1b3474', 'volume_name': 'volume-e9b564b7-971c-4524-8bcc-158e9c1b3474', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ec9382-fe25-46c3-8ff5-1bed6874d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ec9382-fe25-46c3-8ff5-1bed6874d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b729db-0b99-4aab-840d-52539f14dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Volume e9b564b7-971c-4524-8bcc-158e9c1b3474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b564b7-971c-4524-8bcc-158e9c1b3474', 'volume_size': 1}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f02a963-9517-41a5-90de-7e63b23064ce,created_at=2026-07-23T01:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343514300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f02a963-9517-41a5-90de-7e63b23064ce,host='devstack@QuobyteHD#QuobyteHD',id=e9b564b7-971c-4524-8bcc-158e9c1b3474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:15Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb4dd547-40a4-4450-8c29-9fd1ce14a8b0),volume_type_id=cb4dd547-40a4-4450-8c29-9fd1ce14a8b0)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Creating volume e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:20:15 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:15 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 1073741824
Jul 23 03:20:15 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:15 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 1073741824" returned: 0 in 0.495s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:15 devstack sudo[94441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474
Jul 23 03:20:15 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:16 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b729db-0b99-4aab-840d-52539f14dd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b564b7-971c-4524-8bcc-158e9c1b3474', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de431b5-1a7f-4d58-bd81-331c0f3d02c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Volume volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 (e9b564b7-971c-4524-8bcc-158e9c1b3474): created successfully
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de431b5-1a7f-4d58-bd81-331c0f3d02c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (9e619dbc-40d3-49b4-9274-ca75933472d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5bc63d47-2bd3-462c-817d-cc98b0663410 tempest-GroupSnapshotsTest-801124300 None] Created volume successfully.
Jul 23 03:20:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9abafd66-e2dc-4aa2-8fb3-34698b562e19 tempest-GroupSnapshotsTest-801124300 None] Update group completed successfully.
Jul 23 03:20:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-57051f9b-05fe-4aa2-b50e-dc9e3f214560 tempest-GroupSnapshotsTest-801124300 None] Update group completed successfully.
Jul 23 03:20:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6e978f0b-1d2b-4aad-b4db-7ec0473fc923 tempest-GroupSnapshotsTest-801124300 None] Update group completed successfully.
Jul 23 03:20:21 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7f3e3eed-cbdb-41d1-aa35-d6adb0c755ec tempest-GroupSnapshotsTest-801124300 None] Update group completed successfully.
Jul 23 03:20:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] GroupSnapshot b1d51e88-3564-4bf8-ab70-5be4464dc497: creating.
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=86,cinder:SELECT=79,cinder:INSERT=16,cinder:DELETE=4 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Group snapshot b1d51e88-3564-4bf8-ab70-5be4464dc497: creating. {{(pid=88344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Creating offline snapshot 78dfa98d-1c4d-492d-a062-30a0dd7e3429 of volume e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[786a3b67-0b7a-42b1-b3b0-3228d1a9b4fe]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:23 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474
Jul 23 03:20:23 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:23 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:23 devstack sudo[94606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 1G
Jul 23 03:20:23 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:23 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 1G" returned: 0 in 0.418s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:23 devstack sudo[94611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429
Jul 23 03:20:23 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:24 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429" returned: 0 in 0.447s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:24 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:20:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:24 devstack sudo[94618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429
Jul 23 03:20:24 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:24 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:24 devstack sudo[94621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info
Jul 23 03:20:24 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:25 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:25 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:25 devstack sudo[94625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info
Jul 23 03:20:25 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:25 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.info" returned: 0 in 0.467s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Creating offline snapshot e68775c8-2a2a-4d03-9a24-ea3169c23c87 of volume 5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b959b357-beed-4153-b111-63b7fa17b1d1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:25 devstack sudo[94628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b
Jul 23 03:20:25 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:26 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b" returned: 0 in 0.508s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:26 devstack sudo[94636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 1G
Jul 23 03:20:26 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:26 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 1G" returned: 0 in 0.608s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5095eaff-317d-4646-99a3-c9b674d3c92b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:26 devstack sudo[94644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5095eaff-317d-4646-99a3-c9b674d3c92b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87
Jul 23 03:20:26 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:27 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5095eaff-317d-4646-99a3-c9b674d3c92b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87" returned: 0 in 0.375s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:27 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:27 devstack sudo[94654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87
Jul 23 03:20:27 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-ad4bd3e1-b33b-44da-9198-eea573457636 req-4bcfea70-cae6-42e7-8294-07ae891ee9c3 tempest-AttachVolumeTestJSON-902404587 None] Terminate volume connection completed successfully.
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-ad4bd3e1-b33b-44da-9198-eea573457636 req-4bcfea70-cae6-42e7-8294-07ae891ee9c3 tempest-AttachVolumeTestJSON-902404587 None] Deleting attachment 13e04bdd-c6e3-452e-b63d-efe808f0ffb9. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:20:27 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87" returned: 0 in 0.301s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:27 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info
Jul 23 03:20:27 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:27 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:27 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:20:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:27 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info
Jul 23 03:20:27 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:28 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.info" returned: 0 in 0.361s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b5d927f-ff24-418b-ac90-e7cfae0485d8 tempest-GroupSnapshotsTest-801124300 None] group_snapshot b1d51e88-3564-4bf8-ab70-5be4464dc497: created successfully
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Flow 'volume_create_manager' (e65b81b1-ea91-4a2d-b9e6-aa4d28c0f0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0481859c-159d-4da3-a29d-1e14b9212164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0481859c-159d-4da3-a29d-1e14b9212164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-236732678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7df28a3-108b-4afd-8df3-1bd4f1a93efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b471b9836845148352b3ea7d1acaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:29Z,use_quota=True,user_id='157b75d17d074b55a47003e380d359ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f298a19-2094-484a-8512-1cfee08c2dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f298a19-2094-484a-8512-1cfee08c2dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d800061-effb-4b30-a95d-8fbb42259942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d800061-effb-4b30-a95d-8fbb42259942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7df28a3-108b-4afd-8df3-1bd4f1a93efc', 'volume_name': 'volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a05a24e-2a54-4ad4-a213-cc75cb1ba2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a05a24e-2a54-4ad4-a213-cc75cb1ba2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce983532-8785-4e90-93bf-bc3dea627fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:28 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Volume d7df28a3-108b-4afd-8df3-1bd4f1a93efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc', 'volume_size': 1}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-236732678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7df28a3-108b-4afd-8df3-1bd4f1a93efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b471b9836845148352b3ea7d1acaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:29Z,use_quota=True,user_id='157b75d17d074b55a47003e380d359ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Creating volume d7df28a3-108b-4afd-8df3-1bd4f1a93efc {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:20:28 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:20:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:28 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc 1073741824
Jul 23 03:20:28 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:29 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc 1073741824" returned: 0 in 0.592s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:29 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] group_snapshot b1d51e88-3564-4bf8-ab70-5be4464dc497: deleting
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] group_snapshot b1d51e88-3564-4bf8-ab70-5be4464dc497: deleting {{(pid=88344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 23 03:20:29 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc
Jul 23 03:20:29 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-e9b564b7-971c-4524-8bcc-158e9c1b3474" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e9b564b7-971c-4524-8bcc-158e9c1b3474" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-78dfa98d-1c4d-492d-a062-30a0dd7e3429" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-78dfa98d-1c4d-492d-a062-30a0dd7e3429" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Deleting offline snapshot 78dfa98d-1c4d-492d-a062-30a0dd7e3429 of volume e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] snapshot_file for this snap is: volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c05c1-0d80-4e03-b469-455b0e4c81ed]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:29 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc" returned: 0 in 0.334s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce983532-8785-4e90-93bf-bc3dea627fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:29 devstack sudo[94720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429
Jul 23 03:20:29 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9109acb3-7e24-422a-b713-1dbca0410b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:30 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Volume volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc (d7df28a3-108b-4afd-8df3-1bd4f1a93efc): created successfully
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9109acb3-7e24-422a-b713-1dbca0410b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Flow 'volume_create_manager' (e65b81b1-ea91-4a2d-b9e6-aa4d28c0f0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-099e76e6-e6c8-4e6b-9c44-da11e90e67a2 tempest-AttachVolumeNegativeTest-546448200 None] Created volume successfully.
Jul 23 03:20:30 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429" returned: 0 in 0.571s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b564b7-971c-4524-8bcc-158e9c1b3474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[29187ad1-be2a-4f7a-a26e-b8f0579380f2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:30 devstack sudo[94727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474
Jul 23 03:20:30 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:30 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474" returned: 0 in 0.396s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:30 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429
Jul 23 03:20:30 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:31 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429" returned: 0 in 0.743s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:31 devstack sudo[94760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429
Jul 23 03:20:31 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:32 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474.78dfa98d-1c4d-492d-a062-30a0dd7e3429" returned: 0 in 0.468s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-78dfa98d-1c4d-492d-a062-30a0dd7e3429" released by "_delete_snapshot" :: held 2.367s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e9b564b7-971c-4524-8bcc-158e9c1b3474" released by "delete_snapshot" :: held 2.419s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-5095eaff-317d-4646-99a3-c9b674d3c92b" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-5095eaff-317d-4646-99a3-c9b674d3c92b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-e68775c8-2a2a-4d03-9a24-ea3169c23c87" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e68775c8-2a2a-4d03-9a24-ea3169c23c87" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Deleting offline snapshot e68775c8-2a2a-4d03-9a24-ea3169c23c87 of volume 5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] snapshot_file for this snap is: volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[54993bb1-9c77-4134-8a6c-b6e1b29f139b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:32 devstack sudo[94777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87
Jul 23 03:20:32 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-a03d69ac-38ac-4f46-89d0-e67a5735e371 req-10f27402-0df7-4a5a-9a8c-ec4da44b0a57 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-a03d69ac-38ac-4f46-89d0-e67a5735e371 req-10f27402-0df7-4a5a-9a8c-ec4da44b0a57 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-a03d69ac-38ac-4f46-89d0-e67a5735e371 req-10f27402-0df7-4a5a-9a8c-ec4da44b0a57 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-a03d69ac-38ac-4f46-89d0-e67a5735e371 req-10f27402-0df7-4a5a-9a8c-ec4da44b0a57 tempest-AttachVolumeNegativeTest-546448200 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f459768-f6dd-4935-b37d-ea822745b012', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:20:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-a03d69ac-38ac-4f46-89d0-e67a5735e371 req-10f27402-0df7-4a5a-9a8c-ec4da44b0a57 tempest-AttachVolumeNegativeTest-546448200 None] attachment_update completed successfully.
Jul 23 03:20:32 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87" returned: 0 in 0.707s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5095eaff-317d-4646-99a3-c9b674d3c92b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:20:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[054bd554-a4b4-4ab7-bd3a-d9cbbfdc7a1f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:33 devstack sudo[94851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b
Jul 23 03:20:33 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:33 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b" returned: 0 in 0.860s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:33 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87
Jul 23 03:20:33 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:34 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87" returned: 0 in 0.491s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:34 devstack sudo[95256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87
Jul 23 03:20:34 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:34 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b.e68775c8-2a2a-4d03-9a24-ea3169c23c87" returned: 0 in 0.317s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e68775c8-2a2a-4d03-9a24-ea3169c23c87" released by "_delete_snapshot" :: held 2.518s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-5095eaff-317d-4646-99a3-c9b674d3c92b" released by "delete_snapshot" :: held 2.570s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:34 devstack cinder-volume[88344]: WARNING cinder.quota [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1464504934 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1464504934, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:34 devstack cinder-volume[88344]: WARNING cinder.quota [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1464504934 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1464504934, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Created reservations ['f9a83dab-3b65-4b34-a4eb-e84374d851b5', '20309068-0778-474b-a5cf-7297d15b3550', '15009666-f0ba-4e3f-b1ad-8b3fc5c9c30c', '5799def6-526b-4c73-ac85-d92e351dd477'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:34 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] Created reservations ['30fbd6a9-6e2b-4661-80dc-8b96acf3a5b6', 'f6edda31-e2a1-43da-860e-5841f8e1d905', '0e7e19fb-86ef-4900-a8f6-e0f8a9de06e6', 'b1fcb63d-bba6-495a-be5f-30a3b3cd70a7'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:35 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9b017411-25b8-4e4d-a3a3-4fe43a5d11bb tempest-GroupSnapshotsTest-801124300 None] group_snapshot b1d51e88-3564-4bf8-ab70-5be4464dc497: deleted successfully
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-5095eaff-317d-4646-99a3-c9b674d3c92b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-5095eaff-317d-4646-99a3-c9b674d3c92b" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc39c17-8dff-4303-b2e5-e1b27e12be81]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:36 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b
Jul 23 03:20:36 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:36 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b" returned: 0 in 0.466s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:36 devstack sudo[95304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b
Jul 23 03:20:36 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:36 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5095eaff-317d-4646-99a3-c9b674d3c92b" returned: 0 in 0.268s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-5095eaff-317d-4646-99a3-c9b674d3c92b" released by "delete_volume" :: held 0.811s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-e9b564b7-971c-4524-8bcc-158e9c1b3474" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e9b564b7-971c-4524-8bcc-158e9c1b3474" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2287e9-150e-41ad-b4a4-71e93f1a39c9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-72fbfe32-247a-451e-b69b-fa6caefab497 req-5b44a685-ab47-4100-8c05-9b59827eaaee tempest-AttachVolumeNegativeTest-546448200 None] Terminate volume connection completed successfully.
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-72fbfe32-247a-451e-b69b-fa6caefab497 req-5b44a685-ab47-4100-8c05-9b59827eaaee tempest-AttachVolumeNegativeTest-546448200 None] Deleting attachment 2f459768-f6dd-4935-b37d-ea822745b012. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:20:37 devstack sudo[95311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474
Jul 23 03:20:37 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:37 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474" returned: 0 in 0.471s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:37 devstack sudo[95341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474
Jul 23 03:20:37 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:37 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9b564b7-971c-4524-8bcc-158e9c1b3474" returned: 0 in 0.262s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e9b564b7-971c-4524-8bcc-158e9c1b3474" released by "delete_volume" :: held 0.800s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['bd5c795c-4cfd-4ad5-b6d0-67000cbef017'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:37 devstack cinder-volume[88344]: WARNING cinder.quota [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1464504934 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1464504934, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['d897d99a-6f83-44cc-abaa-8eea4b5f435d', 'ae11cee6-93a6-4cbf-abe7-27b6dee071f5', 'c5b98d58-97a3-4d4c-8fb5-f2d678e0cc9f', 'ab96deaf-5eda-434b-a65e-517da9bbf306'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:37 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['676c2e2d-58c8-4b0d-81b3-b16915c5a284', '8c110f88-8445-4482-8d9f-e3e0af1030f2', 'da2e53f0-e5cb-44d6-88fa-ed60df0e53d7', '6a97bedd-052a-4b94-85c4-9229958ec5a7'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:38 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:20:38 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:38 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:38 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:20:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e682449d-18a6-4dab-a411-c95e61161250 tempest-GroupSnapshotsTest-801124300 None] Delete group completed successfully.
Jul 23 03:20:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-48933b58-da75-4fd8-9f19-d3383f0e190f tempest-GroupSnapshotsTest-801124300 None] Group tempest-GroupSnapshotsTest-Group-1562967754: creating
Jul 23 03:20:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-48933b58-da75-4fd8-9f19-d3383f0e190f tempest-GroupSnapshotsTest-801124300 None] Group tempest-GroupSnapshotsTest-Group-1562967754: created successfully
Jul 23 03:20:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-48933b58-da75-4fd8-9f19-d3383f0e190f tempest-GroupSnapshotsTest-801124300 None] Create group completed successfully.
Jul 23 03:20:40 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (b7d87d46-7f11-47da-95de-49654907e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978e432f-d5fe-4bc4-b931-7d346803c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978e432f-d5fe-4bc4-b931-7d346803c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1503374040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cad68795-261c-4cef-99e5-ab715305a75a,host='devstack@QuobyteHD#QuobyteHD',id=c551a6bb-d87e-4d6c-89f7-47fa39669644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:41Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8c44e0-5cd2-4472-aa8c-01158febe897),volume_type_id=2a8c44e0-5cd2-4472-aa8c-01158febe897)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90f12db-ff61-4f9d-8293-ecd64c0d78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90f12db-ff61-4f9d-8293-ecd64c0d78dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad65c42b-03d3-42b8-9226-4c8247668a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad65c42b-03d3-42b8-9226-4c8247668a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c551a6bb-d87e-4d6c-89f7-47fa39669644', 'volume_name': 'volume-c551a6bb-d87e-4d6c-89f7-47fa39669644', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035aebac-cee7-4a74-b6cd-6865ce5ef897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035aebac-cee7-4a74-b6cd-6865ce5ef897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14abf20-834d-4d04-a0f4-5f79cfdbfa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Volume c551a6bb-d87e-4d6c-89f7-47fa39669644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c551a6bb-d87e-4d6c-89f7-47fa39669644', 'volume_size': 1}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cad68795-261c-4cef-99e5-ab715305a75a,created_at=2026-07-23T01:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1503374040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cad68795-261c-4cef-99e5-ab715305a75a,host='devstack@QuobyteHD#QuobyteHD',id=c551a6bb-d87e-4d6c-89f7-47fa39669644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7908365fe6c848d0849247e9a8b19bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:41Z,use_quota=True,user_id='e6bb6d8abae64a4282de2bbbac217dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8c44e0-5cd2-4472-aa8c-01158febe897),volume_type_id=2a8c44e0-5cd2-4472-aa8c-01158febe897)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Creating volume c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:20:41 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:41 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 1073741824
Jul 23 03:20:41 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:41 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 1073741824" returned: 0 in 0.474s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:41 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644
Jul 23 03:20:41 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:41 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644" returned: 0 in 0.257s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14abf20-834d-4d04-a0f4-5f79cfdbfa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c551a6bb-d87e-4d6c-89f7-47fa39669644', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc7b4a7-881d-4762-a624-3c5b49e48231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Volume volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 (c551a6bb-d87e-4d6c-89f7-47fa39669644): created successfully
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc7b4a7-881d-4762-a624-3c5b49e48231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Flow 'volume_create_manager' (b7d87d46-7f11-47da-95de-49654907e725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1ed1e26c-cf32-43d2-a6cd-05bb3afebefe tempest-GroupSnapshotsTest-801124300 None] Created volume successfully.
Jul 23 03:20:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] GroupSnapshot 1e4dc1de-1fb8-44ea-a350-f34f690f2804: creating.
Jul 23 03:20:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Group snapshot 1e4dc1de-1fb8-44ea-a350-f34f690f2804: creating. {{(pid=88344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 23 03:20:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Creating offline snapshot e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 of volume c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:20:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d52c1-87d9-4466-a56c-c0a8b4f591f6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:42 devstack sudo[95382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644
Jul 23 03:20:42 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:43 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644" returned: 0 in 0.500s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:43 devstack sudo[95387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 1G
Jul 23 03:20:43 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:43 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 1G" returned: 0 in 0.640s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:43 devstack sudo[95392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07
Jul 23 03:20:43 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:44 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" returned: 0 in 0.348s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:44 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:20:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:44 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07
Jul 23 03:20:44 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:44 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" returned: 0 in 0.321s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:44 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info
Jul 23 03:20:44 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:44 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info" returned: 0 in 0.342s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:44 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:20:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:44 devstack sudo[95404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info
Jul 23 03:20:44 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:45 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.info" returned: 0 in 0.251s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-75e105f7-7a88-4f14-8d20-938806eb14d1 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 1e4dc1de-1fb8-44ea-a350-f34f690f2804: created successfully
Jul 23 03:20:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 1e4dc1de-1fb8-44ea-a350-f34f690f2804: deleting
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 1e4dc1de-1fb8-44ea-a350-f34f690f2804: deleting {{(pid=88344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-c551a6bb-d87e-4d6c-89f7-47fa39669644" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-c551a6bb-d87e-4d6c-89f7-47fa39669644" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Deleting offline snapshot e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 of volume c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] snapshot_file for this snap is: volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0d6e0-40ae-4423-865c-c214df3d760c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:46 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07
Jul 23 03:20:46 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Flow 'volume_create_manager' (80ae69d4-76b9-4d09-b976-221f515f75db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2562afb2-2d1e-43f0-84bd-af7820b0b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2562afb2-2d1e-43f0-84bd-af7820b0b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2126938202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45640aa4-0476-4073-9377-633aad162fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd7b644d77343f5a04e1fe77b5bec92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:47Z,use_quota=True,user_id='4933b37631474ffd8af6e8c0940d1f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c7add0-c979-48c0-b883-2834064dc873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c7add0-c979-48c0-b883-2834064dc873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea5147e-19d1-4f34-9a66-324a3d685f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea5147e-19d1-4f34-9a66-324a3d685f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45640aa4-0476-4073-9377-633aad162fb5', 'volume_name': 'volume-45640aa4-0476-4073-9377-633aad162fb5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb36d20-c792-4ec9-b174-bf222814f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb36d20-c792-4ec9-b174-bf222814f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6998746-a90d-4e5f-8069-4ed74527b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:46 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Volume 45640aa4-0476-4073-9377-633aad162fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45640aa4-0476-4073-9377-633aad162fb5', 'volume_size': 1}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2126938202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45640aa4-0476-4073-9377-633aad162fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd7b644d77343f5a04e1fe77b5bec92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:47Z,use_quota=True,user_id='4933b37631474ffd8af6e8c0940d1f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Creating volume 45640aa4-0476-4073-9377-633aad162fb5 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:46 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:20:46 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" returned: 0 in 0.687s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c551a6bb-d87e-4d6c-89f7-47fa39669644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:20:46 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5 1073741824
Jul 23 03:20:46 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:47 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02ee01-0e41-4bee-8a2c-2b954eca2512]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:47 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644
Jul 23 03:20:47 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:47 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644" returned: 0 in 0.477s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:47 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07
Jul 23 03:20:47 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:47 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5 1073741824" returned: 0 in 0.808s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:47 devstack sudo[95432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5
Jul 23 03:20:47 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:48 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5" returned: 0 in 0.360s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6998746-a90d-4e5f-8069-4ed74527b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45640aa4-0476-4073-9377-633aad162fb5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bda4d7-02fd-44b0-a437-7d2213401ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:20:48 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Volume volume-45640aa4-0476-4073-9377-633aad162fb5 (45640aa4-0476-4073-9377-633aad162fb5): created successfully
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bda4d7-02fd-44b0-a437-7d2213401ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Flow 'volume_create_manager' (80ae69d4-76b9-4d09-b976-221f515f75db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:20:48 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-273116cb-2a3e-4291-9af9-9483729983a9 tempest-AttachVolumeShelveTestJSON-206010705 None] Created volume successfully.
Jul 23 03:20:48 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" returned: 0 in 0.871s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:48 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07
Jul 23 03:20:48 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:48 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644.e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-e4ec8241-ac6a-4a64-a0d4-fe42555e3a07" released by "_delete_snapshot" :: held 2.537s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-c551a6bb-d87e-4d6c-89f7-47fa39669644" released by "delete_snapshot" :: held 2.585s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:48 devstack cinder-volume[88344]: WARNING cinder.quota [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2092816328 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2092816328, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:48 devstack cinder-volume[88344]: WARNING cinder.quota [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2092816328 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2092816328, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:48 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['ab4caa4b-62b2-4e49-8123-7e2805eb8ceb', '88755c16-de61-4a85-a827-f1581042fe44', 'b64bf30e-0266-400d-9d9b-4efcc135a83f', '012a68e1-de75-4433-8ebb-52153d9cb946'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:48 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e54cb6e0-1524-413b-a64c-5456d58f4e73 tempest-GroupSnapshotsTest-801124300 None] group_snapshot 1e4dc1de-1fb8-44ea-a350-f34f690f2804: deleted successfully
Jul 23 03:20:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "cinder-quobyte-c551a6bb-d87e-4d6c-89f7-47fa39669644" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:20:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-c551a6bb-d87e-4d6c-89f7-47fa39669644" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:20:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[37489226-1be8-43c6-bf7c-36fd96c1e9dd]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:20:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:50 devstack sudo[95467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644
Jul 23 03:20:50 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:50 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644" returned: 0 in 0.432s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:50 devstack sudo[95472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644
Jul 23 03:20:50 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:50 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c551a6bb-d87e-4d6c-89f7-47fa39669644" returned: 0 in 0.524s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Lock "cinder-quobyte-c551a6bb-d87e-4d6c-89f7-47fa39669644" released by "delete_volume" :: held 1.046s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['11b6b9da-71c1-4e4d-8132-06f7fef0f599'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:51 devstack cinder-volume[88344]: WARNING cinder.quota [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2092816328 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2092816328, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Created reservations ['6d1ff6ae-9141-46d2-8da6-31d36d3f1674', '29feac43-c593-408b-9905-aa09d926bdd1', '3ab71506-11d4-4f73-9a23-74fa64829bde', 'e77e6608-95b9-4555-b603-845630867605'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:51 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:20:51 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:51 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.418s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:51 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:20:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c32de15c-0b8b-458b-afcf-78a849dae540 tempest-GroupSnapshotsTest-801124300 None] Delete group completed successfully.
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:20:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:20:58 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:20:58 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:20:59 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Jul 23 03:20:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.487s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:20:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:20:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:20:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 8 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:20:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:21:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fa9bdba2-a1c2-4f0c-b13c-e5cddd2367f3 tempest-GroupSnapshotsV319Test-1029742596 None] Group tempest-GroupSnapshotsV319Test-Group-1582218990: creating
Jul 23 03:21:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fa9bdba2-a1c2-4f0c-b13c-e5cddd2367f3 tempest-GroupSnapshotsV319Test-1029742596 None] Group tempest-GroupSnapshotsV319Test-Group-1582218990: created successfully
Jul 23 03:21:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fa9bdba2-a1c2-4f0c-b13c-e5cddd2367f3 tempest-GroupSnapshotsV319Test-1029742596 None] Create group completed successfully.
Jul 23 03:21:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-bf8174ab-fd7c-4a79-b35f-ace559bcfb90 req-540c4c8c-b9d3-4c1a-966f-ca52553befe5 tempest-AttachVolumeShelveTestJSON-206010705 None] No connector for attachment 0088c749-028a-43f1-bee3-e81059ef9824; skipping storage backend terminate_connection call. {{(pid=88344) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 23 03:21:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-bf8174ab-fd7c-4a79-b35f-ace559bcfb90 req-540c4c8c-b9d3-4c1a-966f-ca52553befe5 tempest-AttachVolumeShelveTestJSON-206010705 None] Deleting attachment 0088c749-028a-43f1-bee3-e81059ef9824. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Flow 'volume_create_manager' (87897d06-562c-4c76-b5ba-0014cd486f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d51a04-94e5-4c20-a7c5-1e7e46c00250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d51a04-94e5-4c20-a7c5-1e7e46c00250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223107125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46a68c7c-1ea2-4061-818d-4a2a19431188,host='devstack@QuobyteHD#QuobyteHD',id=293576aa-038f-4471-bc4c-596486bcb672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3559bfee9d0d4de4aa1574546c8e7b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:03Z,use_quota=True,user_id='a71ad0efe249462d954824fc39fdde37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84aab8f8-1e54-45e6-ba3a-8fa1b853a4de),volume_type_id=84aab8f8-1e54-45e6-ba3a-8fa1b853a4de)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96bc359-7afa-40b7-92bf-f72022faa577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96bc359-7afa-40b7-92bf-f72022faa577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef543327-353f-43b1-af73-5b334a3f52a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef543327-353f-43b1-af73-5b334a3f52a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293576aa-038f-4471-bc4c-596486bcb672', 'volume_name': 'volume-293576aa-038f-4471-bc4c-596486bcb672', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c603ed26-7398-4040-8212-10329f30df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c603ed26-7398-4040-8212-10329f30df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354eeaf3-36c5-4fba-9986-01fcf3e5df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:03 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Volume 293576aa-038f-4471-bc4c-596486bcb672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293576aa-038f-4471-bc4c-596486bcb672', 'volume_size': 1}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=46a68c7c-1ea2-4061-818d-4a2a19431188,created_at=2026-07-23T01:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223107125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=46a68c7c-1ea2-4061-818d-4a2a19431188,host='devstack@QuobyteHD#QuobyteHD',id=293576aa-038f-4471-bc4c-596486bcb672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3559bfee9d0d4de4aa1574546c8e7b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:03Z,use_quota=True,user_id='a71ad0efe249462d954824fc39fdde37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84aab8f8-1e54-45e6-ba3a-8fa1b853a4de),volume_type_id=84aab8f8-1e54-45e6-ba3a-8fa1b853a4de)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Creating volume 293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:03 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:03 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 1073741824
Jul 23 03:21:03 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:03 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 1073741824" returned: 0 in 0.446s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:04 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672
Jul 23 03:21:04 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:04 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672" returned: 0 in 0.300s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354eeaf3-36c5-4fba-9986-01fcf3e5df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293576aa-038f-4471-bc4c-596486bcb672', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988bb265-8e20-44f0-96a3-72e99392ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:04 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Volume volume-293576aa-038f-4471-bc4c-596486bcb672 (293576aa-038f-4471-bc4c-596486bcb672): created successfully
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988bb265-8e20-44f0-96a3-72e99392ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Flow 'volume_create_manager' (87897d06-562c-4c76-b5ba-0014cd486f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:04 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0124eae7-34a1-49a2-bfe7-ea0619bffbe5 tempest-GroupSnapshotsV319Test-1029742596 None] Created volume successfully.
Jul 23 03:21:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] GroupSnapshot b2698f59-9dd7-49ad-9d87-e22661466257: creating.
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Group snapshot b2698f59-9dd7-49ad-9d87-e22661466257: creating. {{(pid=88344) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Creating offline snapshot dd767e67-ea14-4942-bd7d-8ccfe2ec187d of volume 293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[939220e5-8808-417a-8e8b-a0efce6205c9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:05 devstack sudo[95651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672
Jul 23 03:21:05 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:05 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672" returned: 0 in 0.660s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:05 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d 1G
Jul 23 03:21:05 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:06 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d 1G" returned: 0 in 0.772s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293576aa-038f-4471-bc4c-596486bcb672 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:06 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293576aa-038f-4471-bc4c-596486bcb672 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d
Jul 23 03:21:06 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:06 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-293576aa-038f-4471-bc4c-596486bcb672 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d" returned: 0 in 0.348s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:06 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:21:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:07 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d
Jul 23 03:21:07 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:07 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:07 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info
Jul 23 03:21:07 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:07 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info" returned: 0 in 0.369s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:07 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:21:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:07 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info
Jul 23 03:21:07 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:07 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.info" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-63710965-641b-41fc-aadf-ab80ba822560 tempest-GroupSnapshotsV319Test-1029742596 None] group_snapshot b2698f59-9dd7-49ad-9d87-e22661466257: created successfully
Jul 23 03:21:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] group_snapshot b2698f59-9dd7-49ad-9d87-e22661466257: deleting
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] group_snapshot b2698f59-9dd7-49ad-9d87-e22661466257: deleting {{(pid=88344) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "cinder-quobyte-293576aa-038f-4471-bc4c-596486bcb672" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "cinder-quobyte-293576aa-038f-4471-bc4c-596486bcb672" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "cinder-quobyte-dd767e67-ea14-4942-bd7d-8ccfe2ec187d" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "cinder-quobyte-dd767e67-ea14-4942-bd7d-8ccfe2ec187d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Deleting offline snapshot dd767e67-ea14-4942-bd7d-8ccfe2ec187d of volume 293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] snapshot_file for this snap is: volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9977157-8e0d-48c3-b73a-913b980dbc67]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:09 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d
Jul 23 03:21:09 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:09 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d" returned: 0 in 0.435s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-293576aa-038f-4471-bc4c-596486bcb672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:21:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12cb29a-2ddd-4b90-862b-ee4180c2b8ac]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:09 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672
Jul 23 03:21:09 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:09 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672" returned: 0 in 0.396s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:09 devstack sudo[95751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d
Jul 23 03:21:09 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:10 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d" returned: 0 in 0.430s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:10 devstack sudo[95766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d
Jul 23 03:21:10 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:10 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672.dd767e67-ea14-4942-bd7d-8ccfe2ec187d" returned: 0 in 0.290s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "cinder-quobyte-dd767e67-ea14-4942-bd7d-8ccfe2ec187d" released by "_delete_snapshot" :: held 1.694s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "cinder-quobyte-293576aa-038f-4471-bc4c-596486bcb672" released by "delete_snapshot" :: held 1.721s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=94,cinder:UPDATE=80,cinder:INSERT=16 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:21:10 devstack cinder-volume[88344]: WARNING cinder.quota [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2142557228 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2142557228, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:10 devstack cinder-volume[88344]: WARNING cinder.quota [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2142557228 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2142557228, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:10 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] Created reservations ['11f173c4-0ebc-4462-9a74-c116ec32a3da', 'aadc485e-ab1c-4e12-805b-1e9b2bbebff8', '8073fcb6-bd46-401b-b199-4056a921ce7c', '17f820d6-1ec9-4939-9dd4-c4b972df0668'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4f9f1963-268c-47b3-80f4-a7650e4df191 tempest-GroupSnapshotsV319Test-1029742596 None] group_snapshot b2698f59-9dd7-49ad-9d87-e22661466257: deleted successfully
Jul 23 03:21:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "cinder-quobyte-293576aa-038f-4471-bc4c-596486bcb672" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "cinder-quobyte-293576aa-038f-4471-bc4c-596486bcb672" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff90bea-c4f5-4910-a293-0ff15847bce4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:11 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672
Jul 23 03:21:11 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:12 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672" returned: 0 in 0.661s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:12 devstack sudo[95798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672
Jul 23 03:21:12 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-293576aa-038f-4471-bc4c-596486bcb672" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:12 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "cinder-quobyte-293576aa-038f-4471-bc4c-596486bcb672" released by "delete_volume" :: held 1.095s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:12 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Created reservations ['dd68725c-1504-4da1-a3dd-43040cb1af64'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:12 devstack cinder-volume[88344]: WARNING cinder.quota [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2142557228 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2142557228, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:12 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Created reservations ['431ca163-dfdc-4a19-8711-ec1240018609', '46fa7d44-db25-4524-9d05-2a523594956c', 'bfb7980a-9fe3-45f9-902e-4957841f3ed6', '1f9cbb3b-79a1-47d6-ad27-0eed7477a2d9'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:13 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:13 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:13 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.393s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:13 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:13 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e05e4894-ccc5-4cd3-9ff1-3867bc770d19 tempest-GroupSnapshotsV319Test-1029742596 None] Delete group completed successfully.
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Flow 'volume_create_manager' (3eeecc31-3238-40f4-b19e-0094a60205c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21db9d3-b815-43a4-ac7e-27a65becc113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21db9d3-b815-43a4-ac7e-27a65becc113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-373652795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bb37b0-9348-4a25-811d-4fb05d5406fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b471b9836845148352b3ea7d1acaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:19Z,use_quota=True,user_id='157b75d17d074b55a47003e380d359ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01e9f41-7fb2-4ae9-bf31-dd0eca5f26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01e9f41-7fb2-4ae9-bf31-dd0eca5f26ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57489ab-b4c0-48ec-8a50-9159c1cd48b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57489ab-b4c0-48ec-8a50-9159c1cd48b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bb37b0-9348-4a25-811d-4fb05d5406fb', 'volume_name': 'volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab95eb6b-0a47-4f2d-8ff7-cf0ca396f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab95eb6b-0a47-4f2d-8ff7-cf0ca396f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb219a2-615f-45a7-bddb-b13384828f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:18 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Volume e6bb37b0-9348-4a25-811d-4fb05d5406fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb', 'volume_size': 1}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-373652795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bb37b0-9348-4a25-811d-4fb05d5406fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b471b9836845148352b3ea7d1acaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:19Z,use_quota=True,user_id='157b75d17d074b55a47003e380d359ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Creating volume e6bb37b0-9348-4a25-811d-4fb05d5406fb {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:18 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:18 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb 1073741824
Jul 23 03:21:18 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:19 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb 1073741824" returned: 0 in 0.694s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:19 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb
Jul 23 03:21:19 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:19 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb219a2-615f-45a7-bddb-b13384828f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1de070-8861-415f-b9de-ac2febdb68f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Volume volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb (e6bb37b0-9348-4a25-811d-4fb05d5406fb): created successfully
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1de070-8861-415f-b9de-ac2febdb68f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Flow 'volume_create_manager' (3eeecc31-3238-40f4-b19e-0094a60205c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:19 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b5ed4f12-9622-4ccc-b1fd-75c23afddd13 tempest-AttachVolumeNegativeTest-546448200 None] Created volume successfully.
Jul 23 03:21:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-926ca7d7-1dbd-4bdf-b14f-fd09800a0133 req-f89e0812-fab0-4153-8ffc-539b04951105 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-926ca7d7-1dbd-4bdf-b14f-fd09800a0133 req-f89e0812-fab0-4153-8ffc-539b04951105 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-926ca7d7-1dbd-4bdf-b14f-fd09800a0133 req-f89e0812-fab0-4153-8ffc-539b04951105 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-926ca7d7-1dbd-4bdf-b14f-fd09800a0133 req-f89e0812-fab0-4153-8ffc-539b04951105 tempest-AttachVolumeNegativeTest-546448200 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abb257ce-0d42-422c-a01e-454aebe58caa', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:21:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-926ca7d7-1dbd-4bdf-b14f-fd09800a0133 req-f89e0812-fab0-4153-8ffc-539b04951105 tempest-AttachVolumeNegativeTest-546448200 None] attachment_update completed successfully.
Jul 23 03:21:23 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=109,cinder:UPDATE=97,cinder:INSERT=26,cinder:DELETE=5 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:21:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9c998ffa-d4cd-4d31-a525-a0299263a4eb tempest-GroupsTest-1420967794 None] Group tempest-Group1-565606931: creating
Jul 23 03:21:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9c998ffa-d4cd-4d31-a525-a0299263a4eb tempest-GroupsTest-1420967794 None] Group tempest-Group1-565606931: created successfully
Jul 23 03:21:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9c998ffa-d4cd-4d31-a525-a0299263a4eb tempest-GroupsTest-1420967794 None] Create group completed successfully.
Jul 23 03:21:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e67a27e-c557-4bb3-aa78-cafc1aa8223c tempest-GroupsTest-1420967794 None] Group tempest-Group2-452750973: creating
Jul 23 03:21:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e67a27e-c557-4bb3-aa78-cafc1aa8223c tempest-GroupsTest-1420967794 None] Group tempest-Group2-452750973: created successfully
Jul 23 03:21:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e67a27e-c557-4bb3-aa78-cafc1aa8223c tempest-GroupsTest-1420967794 None] Create group completed successfully.
Jul 23 03:21:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-f4e44cf2-399c-423c-acc0-af493ca6619c req-f8fd1d60-d185-41e2-b2aa-959ab3ebc2a6 tempest-AttachVolumeNegativeTest-546448200 None] Terminate volume connection completed successfully.
Jul 23 03:21:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-f4e44cf2-399c-423c-acc0-af493ca6619c req-f8fd1d60-d185-41e2-b2aa-959ab3ebc2a6 tempest-AttachVolumeNegativeTest-546448200 None] Deleting attachment abb257ce-0d42-422c-a01e-454aebe58caa. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Flow 'volume_create_manager' (ab7e1c4e-7cfd-4c1d-a626-17521d0484ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b151945-6063-492c-a834-fd3741cf8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b151945-6063-492c-a834-fd3741cf8235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184703339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38559f44-4fab-4bbe-b094-ffaa12598315,host='devstack@QuobyteHD#QuobyteHD',id=8be743a3-4910-48aa-9a2c-f271e1efd52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d1d1262926449795d6af4374364dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:27Z,use_quota=True,user_id='3ff89b51583c48959d0b2a6ec40f8a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0870dbc5-0d7f-4e76-bc90-db4ebfac9d66),volume_type_id=0870dbc5-0d7f-4e76-bc90-db4ebfac9d66)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf6ac6c-38a0-40f8-8153-17b5a9f78339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf6ac6c-38a0-40f8-8153-17b5a9f78339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7468900e-e61e-4ac0-8fe6-d3403aafaa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7468900e-e61e-4ac0-8fe6-d3403aafaa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be743a3-4910-48aa-9a2c-f271e1efd52c', 'volume_name': 'volume-8be743a3-4910-48aa-9a2c-f271e1efd52c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc58a14-2e63-4524-ae0f-72620a415e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc58a14-2e63-4524-ae0f-72620a415e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00881db1-ceeb-4636-a23e-7243e51cd9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Volume 8be743a3-4910-48aa-9a2c-f271e1efd52c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be743a3-4910-48aa-9a2c-f271e1efd52c', 'volume_size': 1}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=38559f44-4fab-4bbe-b094-ffaa12598315,created_at=2026-07-23T01:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184703339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=38559f44-4fab-4bbe-b094-ffaa12598315,host='devstack@QuobyteHD#QuobyteHD',id=8be743a3-4910-48aa-9a2c-f271e1efd52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d1d1262926449795d6af4374364dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:27Z,use_quota=True,user_id='3ff89b51583c48959d0b2a6ec40f8a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0870dbc5-0d7f-4e76-bc90-db4ebfac9d66),volume_type_id=0870dbc5-0d7f-4e76-bc90-db4ebfac9d66)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Creating volume 8be743a3-4910-48aa-9a2c-f271e1efd52c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:26 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:26 devstack sudo[96410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c 1073741824
Jul 23 03:21:26 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:27 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c 1073741824" returned: 0 in 0.653s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:27 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c
Jul 23 03:21:27 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:27 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c" returned: 0 in 0.399s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00881db1-ceeb-4636-a23e-7243e51cd9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be743a3-4910-48aa-9a2c-f271e1efd52c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ccef24-9420-40b5-8602-b298c849a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Volume volume-8be743a3-4910-48aa-9a2c-f271e1efd52c (8be743a3-4910-48aa-9a2c-f271e1efd52c): created successfully
Jul 23 03:21:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ccef24-9420-40b5-8602-b298c849a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Flow 'volume_create_manager' (ab7e1c4e-7cfd-4c1d-a626-17521d0484ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e558fd39-a176-48bf-ba70-c88538492471 tempest-GroupsTest-1420967794 None] Created volume successfully.
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Acquiring lock "cinder-quobyte-8be743a3-4910-48aa-9a2c-f271e1efd52c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Lock "cinder-quobyte-8be743a3-4910-48aa-9a2c-f271e1efd52c" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bd67c6-2d19-47e3-af74-21ceec597e11]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:30 devstack sudo[96482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c
Jul 23 03:21:30 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:30 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c" returned: 0 in 0.433s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:30 devstack sudo[96487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c
Jul 23 03:21:30 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:30 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8be743a3-4910-48aa-9a2c-f271e1efd52c" returned: 0 in 0.257s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Lock "cinder-quobyte-8be743a3-4910-48aa-9a2c-f271e1efd52c" released by "delete_volume" :: held 0.751s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Created reservations ['05c77944-d698-41dd-a53c-44c763db1a52'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:31 devstack cinder-volume[88344]: WARNING cinder.quota [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-642684224 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-642684224, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:31 devstack cinder-volume[88344]: WARNING cinder.quota [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-642684224 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-642684224, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Created reservations ['c2189735-095d-458a-9fef-599deb6ecc52', 'dd9a5e42-84f9-4c9a-b566-b45afd195edc', '65f414c9-8262-4370-9541-9c1e590a2b89', '7e8351f6-dbf4-4c53-a44b-1781cd266b56'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:31 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:31 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:31 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.268s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c7a6ea4f-2fcc-42e6-9762-f4b1c4781a08 tempest-GroupsTest-1420967794 None] Delete group completed successfully.
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Created reservations ['a0e33e07-a7d7-461d-aa5a-a4d2ef35ec39'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:31 devstack sudo[96499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:31 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:31 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.250s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:31 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f0d9d15c-48ba-4f5e-95fe-f5b258bf2958 tempest-GroupsTest-1420967794 None] Delete group completed successfully.
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "cinder-e6bb37b0-9348-4a25-811d-4fb05d5406fb-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-e6bb37b0-9348-4a25-811d-4fb05d5406fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "cinder-quobyte-e6bb37b0-9348-4a25-811d-4fb05d5406fb" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-quobyte-e6bb37b0-9348-4a25-811d-4fb05d5406fb" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6c275-da73-42af-8515-fc277e80c59c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:32 devstack sudo[96502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb
Jul 23 03:21:32 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:32 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:32 devstack sudo[96509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb
Jul 23 03:21:32 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:33 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e6bb37b0-9348-4a25-811d-4fb05d5406fb" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-quobyte-e6bb37b0-9348-4a25-811d-4fb05d5406fb" released by "delete_volume" :: held 0.708s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Created reservations ['6585b423-f61e-4b5c-9080-8b2aa1faf00c', '431ddf9c-8fce-47fe-ac5d-ad04bafbd895', '20a3d83d-ba80-4e71-8a2a-9f2a6add2eba', 'db968afb-f225-4985-be2c-453fa0951f04'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:33 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:33 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-72a5b797-1953-40b9-bfc8-5a2251f3ce60 tempest-GroupsTest-1420967794 None] Group tempest-GroupsTest-Group-459944986: creating
Jul 23 03:21:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-72a5b797-1953-40b9-bfc8-5a2251f3ce60 tempest-GroupsTest-1420967794 None] Group tempest-GroupsTest-Group-459944986: created successfully
Jul 23 03:21:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-72a5b797-1953-40b9-bfc8-5a2251f3ce60 tempest-GroupsTest-1420967794 None] Create group completed successfully.
Jul 23 03:21:33 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.324s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Deleted volume successfully.
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8536e35e-da77-4553-994d-f368f024cc4d tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-e6bb37b0-9348-4a25-811d-4fb05d5406fb-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "cinder-d7df28a3-108b-4afd-8df3-1bd4f1a93efc-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-d7df28a3-108b-4afd-8df3-1bd4f1a93efc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "cinder-quobyte-d7df28a3-108b-4afd-8df3-1bd4f1a93efc" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-quobyte-d7df28a3-108b-4afd-8df3-1bd4f1a93efc" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0d8212-583d-4dc4-b5cd-8cae1968cba3]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:33 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc
Jul 23 03:21:33 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:34 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:34 devstack sudo[96521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc
Jul 23 03:21:34 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:34 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7df28a3-108b-4afd-8df3-1bd4f1a93efc" returned: 0 in 0.237s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-quobyte-d7df28a3-108b-4afd-8df3-1bd4f1a93efc" released by "delete_volume" :: held 0.628s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Created reservations ['bcc949ca-7520-45bb-aba1-7dc5f042a6ac', '5f819b57-db72-493a-a72a-241614e9ce75', '3f725c2f-658f-4c45-81a1-916b8346ff0f', 'd883f831-86fa-412d-b67a-e1b1cf758720'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:34 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:34 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:34 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.256s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Deleted volume successfully.
Jul 23 03:21:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a67d49-c1c1-4b3c-af74-def0825a4733 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-d7df28a3-108b-4afd-8df3-1bd4f1a93efc-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "cinder-7e5ae84a-f9b9-456e-a010-b8617fd299d5-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-7e5ae84a-f9b9-456e-a010-b8617fd299d5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Flow 'volume_create_manager' (75ad0f5b-9567-49e9-96eb-2bac88d7e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc86266-ccab-499c-a5e6-8814ef79d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc86266-ccab-499c-a5e6-8814ef79d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-112441151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8f33716-92ac-45d3-ae12-1d6bfdcdc719,host='devstack@QuobyteHD#QuobyteHD',id=482856e7-7060-44c2-bd75-4e34a89b0cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d1d1262926449795d6af4374364dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:35Z,use_quota=True,user_id='3ff89b51583c48959d0b2a6ec40f8a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5da0eff3-4804-4d9f-8c27-b0cf85ce3da2),volume_type_id=5da0eff3-4804-4d9f-8c27-b0cf85ce3da2)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da78d5fd-9005-40bb-896c-ec23c660d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da78d5fd-9005-40bb-896c-ec23c660d95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5b25b7-1fc8-4f88-b58c-05da4a7185ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5b25b7-1fc8-4f88-b58c-05da4a7185ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482856e7-7060-44c2-bd75-4e34a89b0cc6', 'volume_name': 'volume-482856e7-7060-44c2-bd75-4e34a89b0cc6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe6c586-b842-4d24-b880-595310696524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe6c586-b842-4d24-b880-595310696524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7f2c46-846b-4e33-8546-b600e838fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:35 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Volume 482856e7-7060-44c2-bd75-4e34a89b0cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482856e7-7060-44c2-bd75-4e34a89b0cc6', 'volume_size': 1}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d8f33716-92ac-45d3-ae12-1d6bfdcdc719,created_at=2026-07-23T01:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-112441151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8f33716-92ac-45d3-ae12-1d6bfdcdc719,host='devstack@QuobyteHD#QuobyteHD',id=482856e7-7060-44c2-bd75-4e34a89b0cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d1d1262926449795d6af4374364dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:35Z,use_quota=True,user_id='3ff89b51583c48959d0b2a6ec40f8a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5da0eff3-4804-4d9f-8c27-b0cf85ce3da2),volume_type_id=5da0eff3-4804-4d9f-8c27-b0cf85ce3da2)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Creating volume 482856e7-7060-44c2-bd75-4e34a89b0cc6 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:35 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:35 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 1073741824
Jul 23 03:21:35 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "cinder-quobyte-7e5ae84a-f9b9-456e-a010-b8617fd299d5" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-quobyte-7e5ae84a-f9b9-456e-a010-b8617fd299d5" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e027a5-fda1-4557-808b-a5efbb4ac061]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:35 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5
Jul 23 03:21:35 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:35 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 1073741824" returned: 0 in 0.463s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:35 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:35 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6
Jul 23 03:21:35 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:35 devstack sudo[96549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5
Jul 23 03:21:35 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:35 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7f2c46-846b-4e33-8546-b600e838fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482856e7-7060-44c2-bd75-4e34a89b0cc6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e51357-22f4-4075-9f6a-5f1802c47d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Volume volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 (482856e7-7060-44c2-bd75-4e34a89b0cc6): created successfully
Jul 23 03:21:36 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e51357-22f4-4075-9f6a-5f1802c47d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Flow 'volume_create_manager' (75ad0f5b-9567-49e9-96eb-2bac88d7e980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7e5ae84a-f9b9-456e-a010-b8617fd299d5" returned: 0 in 0.318s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d0ba68a3-ef34-49db-8e16-58aee00aec15 tempest-GroupsTest-1420967794 None] Created volume successfully.
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-quobyte-7e5ae84a-f9b9-456e-a010-b8617fd299d5" released by "delete_volume" :: held 0.819s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Created reservations ['4f4d798b-a446-47db-a50b-56bdc2743b40', '3ee0cf73-6fb0-496d-a9f3-c9b9024eefc5', '19863219-1c8c-450c-b0a3-6b3027013301', '524a8db1-4663-404f-9c5c-d5de0dce519e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:36 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:36 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:36 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.274s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Deleted volume successfully.
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6324d0bf-4f60-4372-b97f-e23c8b3ba3a2 tempest-AttachVolumeNegativeTest-546448200 None] Lock "cinder-7e5ae84a-f9b9-456e-a010-b8617fd299d5-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Flow 'volume_create_manager' (61bac646-3339-4a0e-bbbe-f661501c8c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4377c5-6fa4-4be2-8269-329ac0c7624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4377c5-6fa4-4be2-8269-329ac0c7624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1859510850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8f33716-92ac-45d3-ae12-1d6bfdcdc719,host='devstack@QuobyteHD#QuobyteHD',id=37c9d870-cb84-4191-919b-c792dfaec4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d1d1262926449795d6af4374364dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:37Z,use_quota=True,user_id='3ff89b51583c48959d0b2a6ec40f8a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5da0eff3-4804-4d9f-8c27-b0cf85ce3da2),volume_type_id=5da0eff3-4804-4d9f-8c27-b0cf85ce3da2)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160496a0-a4bb-4406-9d37-caddcdb0cc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160496a0-a4bb-4406-9d37-caddcdb0cc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833fef02-4848-4980-a7ea-7d10569f25e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833fef02-4848-4980-a7ea-7d10569f25e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c9d870-cb84-4191-919b-c792dfaec4d4', 'volume_name': 'volume-37c9d870-cb84-4191-919b-c792dfaec4d4', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f1c135-1e05-4f0e-8d6b-287ff4527bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f1c135-1e05-4f0e-8d6b-287ff4527bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8a0b6f-f734-47b0-8874-81459fea748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Volume 37c9d870-cb84-4191-919b-c792dfaec4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c9d870-cb84-4191-919b-c792dfaec4d4', 'volume_size': 1}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d8f33716-92ac-45d3-ae12-1d6bfdcdc719,created_at=2026-07-23T01:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1859510850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8f33716-92ac-45d3-ae12-1d6bfdcdc719,host='devstack@QuobyteHD#QuobyteHD',id=37c9d870-cb84-4191-919b-c792dfaec4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d1d1262926449795d6af4374364dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:37Z,use_quota=True,user_id='3ff89b51583c48959d0b2a6ec40f8a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5da0eff3-4804-4d9f-8c27-b0cf85ce3da2),volume_type_id=5da0eff3-4804-4d9f-8c27-b0cf85ce3da2)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Creating volume 37c9d870-cb84-4191-919b-c792dfaec4d4 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:36 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:37 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4 1073741824
Jul 23 03:21:37 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:37 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4 1073741824" returned: 0 in 0.489s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:37 devstack sudo[96598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4
Jul 23 03:21:37 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:37 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8a0b6f-f734-47b0-8874-81459fea748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c9d870-cb84-4191-919b-c792dfaec4d4', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8c5422-50bd-4349-9adb-9429756d056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:37 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Volume volume-37c9d870-cb84-4191-919b-c792dfaec4d4 (37c9d870-cb84-4191-919b-c792dfaec4d4): created successfully
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8c5422-50bd-4349-9adb-9429756d056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Flow 'volume_create_manager' (61bac646-3339-4a0e-bbbe-f661501c8c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3bccd952-ab32-491f-8343-6f13e1882f42 tempest-GroupsTest-1420967794 None] Created volume successfully.
Jul 23 03:21:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b9ecc761-13be-4f88-bc0e-a90cb715d957 tempest-GroupsTest-1420967794 None] Update group completed successfully.
Jul 23 03:21:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-95934808-0a97-4030-819a-6aae69fa2740 tempest-GroupsTest-1420967794 None] Update group completed successfully.
Jul 23 03:21:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Acquiring lock "cinder-quobyte-37c9d870-cb84-4191-919b-c792dfaec4d4" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Lock "cinder-quobyte-37c9d870-cb84-4191-919b-c792dfaec4d4" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:41 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[734e9ecd-27da-4947-a764-49f967c674ef]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:41 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4
Jul 23 03:21:41 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:42 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4" returned: 0 in 0.454s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:42 devstack sudo[96639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4
Jul 23 03:21:42 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:42 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-37c9d870-cb84-4191-919b-c792dfaec4d4" returned: 0 in 0.305s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Lock "cinder-quobyte-37c9d870-cb84-4191-919b-c792dfaec4d4" released by "delete_volume" :: held 0.826s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Acquiring lock "cinder-quobyte-482856e7-7060-44c2-bd75-4e34a89b0cc6" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Lock "cinder-quobyte-482856e7-7060-44c2-bd75-4e34a89b0cc6" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Acquiring lock "cinder-45640aa4-0476-4073-9377-633aad162fb5-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0067d685-c673-476e-a13e-6c438eedd1de]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "cinder-45640aa4-0476-4073-9377-633aad162fb5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Acquiring lock "cinder-quobyte-45640aa4-0476-4073-9377-633aad162fb5" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "cinder-quobyte-45640aa4-0476-4073-9377-633aad162fb5" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[733cc808-7253-40fc-850e-62926fae706a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:42 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6
Jul 23 03:21:42 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:42 devstack sudo[96643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5
Jul 23 03:21:42 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:42 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6" returned: 0 in 0.438s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:43 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6
Jul 23 03:21:43 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:43 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5" returned: 0 in 0.517s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:43 devstack sudo[96654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5
Jul 23 03:21:43 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:43 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-482856e7-7060-44c2-bd75-4e34a89b0cc6" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Lock "cinder-quobyte-482856e7-7060-44c2-bd75-4e34a89b0cc6" released by "delete_volume" :: held 0.817s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Created reservations ['de16bda5-af42-4a30-9174-a85eaf472c69'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:43 devstack cinder-volume[88344]: WARNING cinder.quota [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-816132904 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-816132904, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:43 devstack cinder-volume[88344]: WARNING cinder.quota [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-816132904 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-816132904, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Created reservations ['4c2a0d7f-07f6-43b5-a985-eb78b4090089', '8b3843e5-7e20-4efc-a1d7-f049b500ccc8', 'db7ff467-6188-44dc-91f7-28379c135e56', '6c230375-a8c6-4341-b5cb-1730127f5f04'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:43 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-45640aa4-0476-4073-9377-633aad162fb5" returned: 0 in 0.372s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "cinder-quobyte-45640aa4-0476-4073-9377-633aad162fb5" released by "delete_volume" :: held 0.941s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Created reservations ['16d5e84a-a380-4895-8629-ada5a07ebf20', 'a3802626-cd08-4a8b-9943-7bb0b8484cc9', '74dde187-6926-4155-b936-08d09a5ec1b0', 'fc0bb1d8-c66f-462e-a537-9a427019ae8b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Created reservations ['3ec983b5-7ec5-4082-8b41-d229f4262674', '1696276c-c7bd-47c6-a882-5c84646dd675', '1d88d0a6-ab42-4543-91e2-3df5a40becb0', '1f5b19f9-455b-4eee-9b88-f4bad4828b07'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:43 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:43 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:43 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:43 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:44 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:44 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:44 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Deleted volume successfully.
Jul 23 03:21:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.298s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:44 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3a053141-e61f-4391-9465-027068147286 tempest-GroupsTest-1420967794 None] Delete group completed successfully.
Jul 23 03:21:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ca30fb4b-d38e-4683-91b1-ac8b4dbed9d5 tempest-AttachVolumeShelveTestJSON-206010705 None] Lock "cinder-45640aa4-0476-4073-9377-633aad162fb5-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Flow 'volume_create_manager' (dc22151c-8fa4-4fca-a6f3-112c0a8b8aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992733f0-f5af-4c72-ad6e-d6d5a5e1f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992733f0-f5af-4c72-ad6e-d6d5a5e1f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770132710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85052da1-fbf2-4a7c-93d1-ffba3224d511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5633c3b19d64cbda3e49725907ff3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:47Z,use_quota=True,user_id='d1e5d4e5bfe54da696597f3df1a55584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7f4400-4ac4-4f51-afe3-544f76f4b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7f4400-4ac4-4f51-afe3-544f76f4b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fbaf71-cd34-4f52-a3b6-532d59ba2e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fbaf71-cd34-4f52-a3b6-532d59ba2e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85052da1-fbf2-4a7c-93d1-ffba3224d511', 'volume_name': 'volume-85052da1-fbf2-4a7c-93d1-ffba3224d511', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c63071-8c27-4c4f-a59b-fd1545c5bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c63071-8c27-4c4f-a59b-fd1545c5bba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5350d0e-da50-4e6a-a6cc-e7a24c7737be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:46 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Volume 85052da1-fbf2-4a7c-93d1-ffba3224d511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85052da1-fbf2-4a7c-93d1-ffba3224d511', 'volume_size': 1}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770132710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85052da1-fbf2-4a7c-93d1-ffba3224d511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5633c3b19d64cbda3e49725907ff3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:47Z,use_quota=True,user_id='d1e5d4e5bfe54da696597f3df1a55584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Creating volume 85052da1-fbf2-4a7c-93d1-ffba3224d511 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:46 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:46 devstack sudo[96668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 1073741824
Jul 23 03:21:46 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:47 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 1073741824" returned: 0 in 0.512s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:47 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511
Jul 23 03:21:47 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:47 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511" returned: 0 in 0.281s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5350d0e-da50-4e6a-a6cc-e7a24c7737be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85052da1-fbf2-4a7c-93d1-ffba3224d511', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c63d632-4f3e-4f89-8030-e40369c6a885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:47 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Volume volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 (85052da1-fbf2-4a7c-93d1-ffba3224d511): created successfully
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c63d632-4f3e-4f89-8030-e40369c6a885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Flow 'volume_create_manager' (dc22151c-8fa4-4fca-a6f3-112c0a8b8aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a698bb5d-52b1-4af2-84a3-8d57ae98c20c tempest-AttachVolumeTestJSON-902404587 None] Created volume successfully.
Jul 23 03:21:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-62c9139d-b75b-46bd-bf87-d09d347a5978 req-32ffe44c-b9e0-407d-85ec-f9907a4e1686 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-62c9139d-b75b-46bd-bf87-d09d347a5978 req-32ffe44c-b9e0-407d-85ec-f9907a4e1686 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-62c9139d-b75b-46bd-bf87-d09d347a5978 req-32ffe44c-b9e0-407d-85ec-f9907a4e1686 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-62c9139d-b75b-46bd-bf87-d09d347a5978 req-32ffe44c-b9e0-407d-85ec-f9907a4e1686 tempest-AttachVolumeTestJSON-902404587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-85052da1-fbf2-4a7c-93d1-ffba3224d511', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4cb098c-e8f0-4855-a40a-f7c46eec5aef', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:21:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-62c9139d-b75b-46bd-bf87-d09d347a5978 req-32ffe44c-b9e0-407d-85ec-f9907a4e1686 tempest-AttachVolumeTestJSON-902404587 None] attachment_update completed successfully.
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Flow 'volume_create_manager' (9b1e553e-43b4-4701-91a1-ed6e4843a2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3010388-8b40-423c-860f-d1dc65a0148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3010388-8b40-423c-860f-d1dc65a0148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1445288622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ee5b6f-e7ac-4040-8856-9d330900f748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5633c3b19d64cbda3e49725907ff3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:53Z,use_quota=True,user_id='d1e5d4e5bfe54da696597f3df1a55584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc04ff07-85ef-400c-a216-7f4a884e9b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc04ff07-85ef-400c-a216-7f4a884e9b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d17819-aba6-435b-a310-b016244f27ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d17819-aba6-435b-a310-b016244f27ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ee5b6f-e7ac-4040-8856-9d330900f748', 'volume_name': 'volume-59ee5b6f-e7ac-4040-8856-9d330900f748', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352b5a46-2199-4196-830c-63ec8317a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352b5a46-2199-4196-830c-63ec8317a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a2b784-3700-4b27-a157-9bedfd0f158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:52 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Volume 59ee5b6f-e7ac-4040-8856-9d330900f748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ee5b6f-e7ac-4040-8856-9d330900f748', 'volume_size': 1}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1445288622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ee5b6f-e7ac-4040-8856-9d330900f748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5633c3b19d64cbda3e49725907ff3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:53Z,use_quota=True,user_id='d1e5d4e5bfe54da696597f3df1a55584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Creating volume 59ee5b6f-e7ac-4040-8856-9d330900f748 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:52 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:52 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748 1073741824
Jul 23 03:21:52 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:53 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748 1073741824" returned: 0 in 0.648s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:53 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748
Jul 23 03:21:53 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:53 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a2b784-3700-4b27-a157-9bedfd0f158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ee5b6f-e7ac-4040-8856-9d330900f748', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624f00bd-734d-4941-b190-35fff589af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:53 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Volume volume-59ee5b6f-e7ac-4040-8856-9d330900f748 (59ee5b6f-e7ac-4040-8856-9d330900f748): created successfully
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624f00bd-734d-4941-b190-35fff589af79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Flow 'volume_create_manager' (9b1e553e-43b4-4701-91a1-ed6e4843a2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:53 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6be4add9-6340-44b2-86a9-75f9f7dec44b tempest-AttachVolumeTestJSON-902404587 None] Created volume successfully.
Jul 23 03:21:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ae5d6348-6535-4ea2-880e-7181f8ee75f1 tempest-GroupsV314Test-867217572 None] Group tempest-GroupsV314Test-Group-129447552: creating
Jul 23 03:21:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ae5d6348-6535-4ea2-880e-7181f8ee75f1 tempest-GroupsV314Test-867217572 None] Group tempest-GroupsV314Test-Group-129447552: created successfully
Jul 23 03:21:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ae5d6348-6535-4ea2-880e-7181f8ee75f1 tempest-GroupsV314Test-867217572 None] Create group completed successfully.
Jul 23 03:21:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-96d6d19a-2e14-447c-97f4-549000d2c27b req-91637b2d-113e-48d3-b594-f9a7d6964b5f tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-96d6d19a-2e14-447c-97f4-549000d2c27b req-91637b2d-113e-48d3-b594-f9a7d6964b5f tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-96d6d19a-2e14-447c-97f4-549000d2c27b req-91637b2d-113e-48d3-b594-f9a7d6964b5f tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-96d6d19a-2e14-447c-97f4-549000d2c27b req-91637b2d-113e-48d3-b594-f9a7d6964b5f tempest-AttachVolumeTestJSON-902404587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-59ee5b6f-e7ac-4040-8856-9d330900f748', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1bbe6f4-256d-45ac-8b56-85a9a3c3a229', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:21:56 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-96d6d19a-2e14-447c-97f4-549000d2c27b req-91637b2d-113e-48d3-b594-f9a7d6964b5f tempest-AttachVolumeTestJSON-902404587 None] attachment_update completed successfully.
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Flow 'volume_create_manager' (a004732f-1650-4f5d-ae0d-a8be85dcb768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c64cb3e-4d6d-42d0-a134-08af1bae3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c64cb3e-4d6d-42d0-a134-08af1bae3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2089295147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecdf803f-220f-49b0-895e-0d32b9d563e4,host='devstack@QuobyteHD#QuobyteHD',id=c0ac214f-4325-4d6b-b93b-e0f2a3b0275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b6cc4045274e8dbdfe907b450128e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:56Z,use_quota=True,user_id='80ae4e76c4f24057a86dd6883301f6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e546df-cd4b-4279-aec8-8998ec8bc8a0),volume_type_id=05e546df-cd4b-4279-aec8-8998ec8bc8a0)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f1f017-df7d-41a3-b34c-db4016ca388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f1f017-df7d-41a3-b34c-db4016ca388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21383425-8336-4851-a0f6-d4c7264c8a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21383425-8336-4851-a0f6-d4c7264c8a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ac214f-4325-4d6b-b93b-e0f2a3b0275c', 'volume_name': 'volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd5dbb2-4680-4f37-8c08-619db70aca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd5dbb2-4680-4f37-8c08-619db70aca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769a1561-5893-479d-ae56-d8202b09638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:56 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Volume c0ac214f-4325-4d6b-b93b-e0f2a3b0275c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c', 'volume_size': 1}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ecdf803f-220f-49b0-895e-0d32b9d563e4,created_at=2026-07-23T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2089295147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecdf803f-220f-49b0-895e-0d32b9d563e4,host='devstack@QuobyteHD#QuobyteHD',id=c0ac214f-4325-4d6b-b93b-e0f2a3b0275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b6cc4045274e8dbdfe907b450128e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:56Z,use_quota=True,user_id='80ae4e76c4f24057a86dd6883301f6cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e546df-cd4b-4279-aec8-8998ec8bc8a0),volume_type_id=05e546df-cd4b-4279-aec8-8998ec8bc8a0)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Creating volume c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:21:56 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:21:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:56 devstack sudo[97108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c 1073741824
Jul 23 03:21:56 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:57 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c 1073741824" returned: 0 in 0.608s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:57 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:21:57 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:57 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.270s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769a1561-5893-479d-ae56-d8202b09638c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68963eac-5d9e-4f66-9744-2e51d3c16d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:21:57 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Volume volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c (c0ac214f-4325-4d6b-b93b-e0f2a3b0275c): created successfully
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68963eac-5d9e-4f66-9744-2e51d3c16d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:21:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Flow 'volume_create_manager' (a004732f-1650-4f5d-ae0d-a8be85dcb768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:21:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-55ed516c-5ec5-4242-a35a-0132124bb98b tempest-GroupsV314Test-867217572 None] Created volume successfully.
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:58 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Cloning volume c0ac214f-4325-4d6b-b93b-e0f2a3b0275c to volume d174ecb8-3d94-499b-a0c1-685c6fa367b9
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Creating offline snapshot b45c7eb0-fc8a-4994-99d1-66e3f135c8fa of volume c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b9094b-5ca6-4a0d-acd1-98191c7887ea]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:21:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:58 devstack sudo[97119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:21:58 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:58 devstack sudo[97121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:21:58 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.489s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:59 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:59 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.353s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 8 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:21:59 devstack sudo[97127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa 1G
Jul 23 03:21:59 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:21:59 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-31f79f51-d99b-497c-8d41-a8ab03146f4f req-902c6cd7-f63c-400a-b118-9deb15d481e8 tempest-AttachVolumeTestJSON-902404587 None] Terminate volume connection completed successfully.
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-31f79f51-d99b-497c-8d41-a8ab03146f4f req-902c6cd7-f63c-400a-b118-9deb15d481e8 tempest-AttachVolumeTestJSON-902404587 None] Deleting attachment f4cb098c-e8f0-4855-a40a-f7c46eec5aef. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:21:59 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa 1G" returned: 0 in 0.537s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:21:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:21:59 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa
Jul 23 03:21:59 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:00 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:00 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:22:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:00 devstack sudo[97148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa
Jul 23 03:22:00 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:00 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" returned: 0 in 0.453s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:00 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info
Jul 23 03:22:00 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:00 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info" returned: 0 in 0.318s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:00 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:22:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:00 devstack sudo[97157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info
Jul 23 03:22:00 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-156e5daf-6a7e-422c-b3e8-cda70a4f597b req-3630a714-8647-42ae-912c-c8db548ae4c6 tempest-AttachVolumeTestJSON-902404587 None] Terminate volume connection completed successfully.
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-156e5daf-6a7e-422c-b3e8-cda70a4f597b req-3630a714-8647-42ae-912c-c8db548ae4c6 tempest-AttachVolumeTestJSON-902404587 None] Deleting attachment e1bbe6f4-256d-45ac-8b56-85a9a3c3a229. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:22:01 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.info" returned: 0 in 0.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Acquiring lock "cinder-quobyte-d174ecb8-3d94-499b-a0c1-685c6fa367b9" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-d174ecb8-3d94-499b-a0c1-685c6fa367b9" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] snapshot: b45c7eb0-fc8a-4994-99d1-66e3f135c8fa, volume: d174ecb8-3d94-499b-a0c1-685c6fa367b9,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4239c2-0416-42f6-a7ad-b2da7e3d3193]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:01 devstack sudo[97187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa
Jul 23 03:22:01 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:01 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" returned: 0 in 0.574s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf57dd7-5e6c-4348-b7b5-d72c20ec9a79]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:02 devstack sudo[97193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:22:02 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:02 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.557s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:02 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:22:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:02 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9
Jul 23 03:22:02 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:08 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9" returned: 0 in 6.399s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[298a2b8f-7e53-4d28-87eb-99cd7bf31a66]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:09 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:22:09 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:09 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.641s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:22:09 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Converted 1024.00 MB image at 160.00 MB/s
Jul 23 03:22:09 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 is being set with open permissions: ugo+rw: NotImplementedError
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:09 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9
Jul 23 03:22:09 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "cinder-59ee5b6f-e7ac-4040-8856-9d330900f748-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-59ee5b6f-e7ac-4040-8856-9d330900f748-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:09 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9" returned: 0 in 0.302s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "cinder-quobyte-59ee5b6f-e7ac-4040-8856-9d330900f748" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-d174ecb8-3d94-499b-a0c1-685c6fa367b9" released by "_copy_volume_from_snapshot" :: held 8.618s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Acquiring lock "cinder-quobyte-b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-quobyte-59ee5b6f-e7ac-4040-8856-9d330900f748" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Deleting offline snapshot b45c7eb0-fc8a-4994-99d1-66e3f135c8fa of volume c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] snapshot_file for this snap is: volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1565e6-5b7e-4a1e-9b7d-ab173b1ab432]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cf5ce3-4e95-49fd-840f-41e2009ffb34]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Flow 'volume_create_manager' (c2168024-929f-4913-90bc-1dadc7e1bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb5cd43-8fc6-4349-9dd7-4e7d0c33d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb5cd43-8fc6-4349-9dd7-4e7d0c33d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1027704650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c13fb3-c71f-4546-802a-0cec19dfcb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326e4d58801b4c5fa9d55ccf889c9a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:10Z,use_quota=True,user_id='d3af17da555b443b926803fc960c2c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70776657-ddd1-4614-8c6d-8658ed82bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70776657-ddd1-4614-8c6d-8658ed82bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa6dc27-8dea-4de5-bba8-7edb2d97da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa6dc27-8dea-4de5-bba8-7edb2d97da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c13fb3-c71f-4546-802a-0cec19dfcb72', 'volume_name': 'volume-40c13fb3-c71f-4546-802a-0cec19dfcb72', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:10 devstack sudo[97252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748
Jul 23 03:22:10 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309e9157-500a-4f80-832e-f4893b1336ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309e9157-500a-4f80-832e-f4893b1336ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3980ff-986d-4d8a-a483-e97adc368c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:10 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Volume 40c13fb3-c71f-4546-802a-0cec19dfcb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c13fb3-c71f-4546-802a-0cec19dfcb72', 'volume_size': 1}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:10 devstack sudo[97253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa
Jul 23 03:22:10 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:10 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748" returned: 0 in 0.371s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:10 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748
Jul 23 03:22:10 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:10 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" returned: 0 in 0.427s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b57451-7062-4aa8-bc5a-d3ac57129840]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:10 devstack sudo[97264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:22:10 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:10 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-59ee5b6f-e7ac-4040-8856-9d330900f748" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-quobyte-59ee5b6f-e7ac-4040-8856-9d330900f748" released by "delete_volume" :: held 0.758s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Created reservations ['92cc9881-4269-4baf-a6eb-252d7946f2e8', '82155a01-5354-4a75-a27e-3c012f72f128', 'a06861bd-7088-4276-a281-785c4aec471a', 'd9debbf0-8b5e-46d7-9b8f-21b4774ce190'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:10 devstack sudo[97270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:10 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:10 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.403s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:10 devstack sudo[97272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa
Jul 23 03:22:10 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "cinder-85052da1-fbf2-4a7c-93d1-ffba3224d511-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-85052da1-fbf2-4a7c-93d1-ffba3224d511-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:11 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.329s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:INSERT=26,cinder:UPDATE=130,cinder:SELECT=119,cinder:DELETE=6 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:22:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Deleted volume successfully.
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "cinder-quobyte-85052da1-fbf2-4a7c-93d1-ffba3224d511" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-34bce1d7-60bf-4af7-94b6-1f92b0dfcf52 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-59ee5b6f-e7ac-4040-8856-9d330900f748-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-quobyte-85052da1-fbf2-4a7c-93d1-ffba3224d511" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d9b4f8-7900-4962-9384-f888d6ff8e74]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:11 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:11 devstack sudo[97278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" returned: 0 in 0.473s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:11 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:11 devstack sudo[97280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa
Jul 23 03:22:11 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:11 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:11 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c.b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" returned: 0 in 0.263s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:11 devstack sudo[97287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511
Jul 23 03:22:11 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-b45c7eb0-fc8a-4994-99d1-66e3f135c8fa" released by "_delete_snapshot" :: held 1.683s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.082s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1027704650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c13fb3-c71f-4546-802a-0cec19dfcb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326e4d58801b4c5fa9d55ccf889c9a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:10Z,use_quota=True,user_id='d3af17da555b443b926803fc960c2c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Creating volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:11 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:11 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 1073741824
Jul 23 03:22:11 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d62b5d07-96c8-4391-b908-6e209aff72f5 tempest-GroupsV314Test-867217572 None] Create group from source-group-ecdf803f-220f-49b0-895e-0d32b9d563e4 completed successfully.
Jul 23 03:22:11 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-85052da1-fbf2-4a7c-93d1-ffba3224d511" returned: 0 in 0.265s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-quobyte-85052da1-fbf2-4a7c-93d1-ffba3224d511" released by "delete_volume" :: held 0.685s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:11 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Created reservations ['ba170e9c-09d4-474f-b15e-7552b29e2954', 'bc016071-8fae-4bdd-bb37-a7c3a670719d', 'bd53ef85-7a0b-4204-ac84-f4a666a7ccb8', '9cb4f7b0-6868-4550-bcd8-524402bdc021'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:12 devstack sudo[97296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:12 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:12 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 1073741824" returned: 0 in 0.564s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:12 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72
Jul 23 03:22:12 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:12 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.352s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Deleted volume successfully.
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "cinder-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f98ebc65-60c2-4c61-b58d-34db030706a8 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-85052da1-fbf2-4a7c-93d1-ffba3224d511-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "cinder-quobyte-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-quobyte-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7492210-7645-4651-a6f7-c58e81f24e7f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:12 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72" returned: 0 in 0.335s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3980ff-986d-4d8a-a483-e97adc368c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c13fb3-c71f-4546-802a-0cec19dfcb72', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e18fcac-f065-4d9e-bd63-844cd5ff0c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Volume volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 (40c13fb3-c71f-4546-802a-0cec19dfcb72): created successfully
Jul 23 03:22:12 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8
Jul 23 03:22:12 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e18fcac-f065-4d9e-bd63-844cd5ff0c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Flow 'volume_create_manager' (c2168024-929f-4913-90bc-1dadc7e1bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-58acc4f5-047a-4173-a170-13f3dc70c3c7 tempest-SnapshotsActionsTest-687989460 None] Created volume successfully.
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Acquiring lock "cinder-quobyte-d174ecb8-3d94-499b-a0c1-685c6fa367b9" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-d174ecb8-3d94-499b-a0c1-685c6fa367b9" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace872f-0b94-446f-89d3-5e2c4925ed45]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:13 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8" returned: 0 in 0.487s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:13 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9
Jul 23 03:22:13 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8
Jul 23 03:22:13 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:13 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:13 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8" returned: 0 in 0.343s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-quobyte-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8" released by "delete_volume" :: held 0.890s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:13 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9" returned: 0 in 0.541s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:13 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9
Jul 23 03:22:13 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Creating offline snapshot 2df7b046-5cb3-4b03-a16e-320cfd7cb012 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Created reservations ['73ea146c-889f-49ba-868c-0b216b5cf62d', '18bd72f6-66e5-40b9-a246-e1614289d671', '2dae30af-c98f-4a78-9a2c-af6a2ab50868', '6fe209e3-3286-44b6-bc7e-9b53e982b510'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[65088760-ffbc-49d4-8aa8-d94d2cb517f2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:13 devstack sudo[97318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:13 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:13 devstack sudo[97317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72
Jul 23 03:22:13 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:13 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d174ecb8-3d94-499b-a0c1-685c6fa367b9" returned: 0 in 0.318s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-d174ecb8-3d94-499b-a0c1-685c6fa367b9" released by "delete_volume" :: held 0.915s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Created reservations ['c8d1f32e-0fa7-4daf-b604-dea491e6e7cf'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:13 devstack cinder-volume[88344]: WARNING cinder.quota [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1949970164 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1949970164, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:13 devstack cinder-volume[88344]: WARNING cinder.quota [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1949970164 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1949970164, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Created reservations ['e06339e4-e0c9-4645-87ba-c08e215f595d', '3a5e3dfb-40ae-40df-80a7-85506a58ad78', '54dfd7b7-270c-498a-809c-87ea38164c75', '777651b3-4e48-466d-9a96-3dc34f0c0402'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:13 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.309s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:13 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Deleted volume successfully.
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-df5bd7df-0024-4c37-a314-c810011218d3 tempest-AttachVolumeTestJSON-902404587 None] Lock "cinder-4f0c7497-1bf0-43b6-bf1f-37eb021df6e8-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:14 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72" returned: 0 in 0.507s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:14 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 1G
Jul 23 03:22:14 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:14 devstack sudo[97327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:14 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:14 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.288s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-57c8deff-37bd-4b6e-a808-3452dd865410 tempest-GroupsV314Test-867217572 None] Delete group completed successfully.
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Acquiring lock "cinder-quobyte-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b780a0d-690b-43ef-82f4-495049375537]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:14 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 1G" returned: 0 in 0.647s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:14 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:22:14 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:14 devstack sudo[97337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:14 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:15 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.411s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:15 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c
Jul 23 03:22:15 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:15 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:15 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 is being set with open permissions: ugo+rw
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:15 devstack sudo[97348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:15 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:15 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" returned: 0 in 0.295s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:15 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Lock "cinder-quobyte-c0ac214f-4325-4d6b-b93b-e0f2a3b0275c" released by "delete_volume" :: held 0.783s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.291s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:15 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info
Jul 23 03:22:15 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Created reservations ['5ae81390-b647-47d0-9b81-71afc60b9e02'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Created reservations ['36c84e60-edf1-4aa8-84ac-ef41d6901ec3', 'de974cc9-c2dc-4321-ac56-22dc62609cd5', '43a5612d-aadf-4f93-a886-598c82058d7a', 'f9fdbbc9-05fc-455c-9cad-4cce2942024a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:15 devstack sudo[97355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:15 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:15 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info" returned: 0 in 0.352s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:15 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info is being set with open permissions: ugo+rw
Jul 23 03:22:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:15 devstack sudo[97357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info
Jul 23 03:22:15 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:16 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.info" returned: 0 in 0.289s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:16 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.391s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:16 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8802050c-0f8d-47df-b6b1-babf8e902942 tempest-GroupsV314Test-867217572 None] Delete group completed successfully.
Jul 23 03:22:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c97289f6-d17e-4bd0-893f-2772ed5e23e7 tempest-SnapshotsActionsTest-687989460 None] Create snapshot completed successfully
Jul 23 03:22:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Creating offline snapshot 4d31289a-25c3-42ed-a00e-832069018a20 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241cd05-6da6-4f15-a965-ad5c33cf2695]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:18 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:18 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:18 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.567s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:18 devstack sudo[97368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 1G
Jul 23 03:22:18 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:19 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 1G" returned: 0 in 0.708s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:19 devstack sudo[97374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20
Jul 23 03:22:19 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:19 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20" returned: 0 in 0.570s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:19 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 is being set with open permissions: ugo+rw
Jul 23 03:22:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:19 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20
Jul 23 03:22:19 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Flow 'volume_create_manager' (f32489e7-88a9-412a-b047-0d7b626bf414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63366a28-2833-4721-a4da-d856a73520fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63366a28-2833-4721-a4da-d856a73520fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1088177329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27418e13-0698-4e55-a618-e8241c3d5534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699263e1e172450c9a05eb7808222cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:20Z,use_quota=True,user_id='8a7ac722b3e943319ec0efbcc497508c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f95f7b-3af5-4d1e-95ca-d446389094c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f95f7b-3af5-4d1e-95ca-d446389094c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180d1a9f-7ab4-4265-8df4-42106c5354bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180d1a9f-7ab4-4265-8df4-42106c5354bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27418e13-0698-4e55-a618-e8241c3d5534', 'volume_name': 'volume-27418e13-0698-4e55-a618-e8241c3d5534', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934c5a8a-ad07-460b-b226-d311f2316dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934c5a8a-ad07-460b-b226-d311f2316dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1ce4ce-043f-4eb0-86e1-a1a03f9bd4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:20 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Volume 27418e13-0698-4e55-a618-e8241c3d5534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27418e13-0698-4e55-a618-e8241c3d5534', 'volume_size': 1}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:20 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20" returned: 0 in 0.311s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1088177329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27418e13-0698-4e55-a618-e8241c3d5534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699263e1e172450c9a05eb7808222cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:20Z,use_quota=True,user_id='8a7ac722b3e943319ec0efbcc497508c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Creating volume 27418e13-0698-4e55-a618-e8241c3d5534 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:20 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:20 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534 1073741824
Jul 23 03:22:20 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-634fdb28-cdcc-4ab1-852c-e390bf45c324 tempest-SnapshotsActionsTest-687989460 None] Create snapshot completed successfully
Jul 23 03:22:20 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534 1073741824" returned: 0 in 0.516s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:20 devstack sudo[97389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534
Jul 23 03:22:20 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:21 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534" returned: 0 in 0.274s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1ce4ce-043f-4eb0-86e1-a1a03f9bd4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27418e13-0698-4e55-a618-e8241c3d5534', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f61fb49-b888-4c78-9df3-9ab015e69e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:21 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Volume volume-27418e13-0698-4e55-a618-e8241c3d5534 (27418e13-0698-4e55-a618-e8241c3d5534): created successfully
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f61fb49-b888-4c78-9df3-9ab015e69e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Flow 'volume_create_manager' (f32489e7-88a9-412a-b047-0d7b626bf414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:21 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e838b97a-5a61-4915-8636-76be3a8104fb tempest-VolumeQuotasAdminTestJSON-504290014 None] Created volume successfully.
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-4d31289a-25c3-42ed-a00e-832069018a20-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-4d31289a-25c3-42ed-a00e-832069018a20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-4d31289a-25c3-42ed-a00e-832069018a20" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-4d31289a-25c3-42ed-a00e-832069018a20" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Deleting offline snapshot 4d31289a-25c3-42ed-a00e-832069018a20 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] snapshot_file for this snap is: volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebab21f-77d7-4aa2-9845-76b46f751cc5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:21 devstack sudo[97392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20
Jul 23 03:22:21 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:21 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20" returned: 0 in 0.409s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7c6873-bc4d-4927-8116-69402855f188]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:21 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:21 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "cinder-27418e13-0698-4e55-a618-e8241c3d5534-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "cinder-27418e13-0698-4e55-a618-e8241c3d5534-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:22 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "cinder-quobyte-27418e13-0698-4e55-a618-e8241c3d5534" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.484s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "cinder-quobyte-27418e13-0698-4e55-a618-e8241c3d5534" acquired by "delete_volume" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:22 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20
Jul 23 03:22:22 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ebe72b-2f25-40e8-a8a8-1fceae010c37]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:22 devstack sudo[97405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534
Jul 23 03:22:22 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:22 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534" returned: 0 in 0.443s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:22 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20" returned: 0 in 0.524s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:22 devstack sudo[97414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534
Jul 23 03:22:22 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:22 devstack sudo[97416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20
Jul 23 03:22:22 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:23 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-27418e13-0698-4e55-a618-e8241c3d5534" returned: 0 in 0.307s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "cinder-quobyte-27418e13-0698-4e55-a618-e8241c3d5534" released by "delete_volume" :: held 0.798s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:23 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.4d31289a-25c3-42ed-a00e-832069018a20" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-4d31289a-25c3-42ed-a00e-832069018a20" released by "_delete_snapshot" :: held 1.858s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" released by "delete_snapshot" :: held 1.890s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:23 devstack cinder-volume[88344]: WARNING cinder.quota [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Created reservations ['ce55ab87-f674-4f67-8729-e3ea3d068c32', '63494049-c70b-4d6c-a431-a8ef540a33fe', '04c0abfe-1e84-4551-a198-6b3b3a72acde', 'b3d82da0-fc9b-4a17-aa81-dff9dab73311'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Created reservations ['4fae26b9-3b69-4959-ae2c-4e0c6937e675', '8a238149-df45-4ba8-bf48-3bfc6e074801', 'e1c0f969-50ca-4764-9b1d-3a260c9762b3', '17f5e3fd-708b-4850-b5be-d90cb9178bfe'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=138,cinder:UPDATE=154,cinder:INSERT=31,cinder:DELETE=6 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:22:23 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Delete snapshot completed successfully.
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8bf26b16-4e2d-4d6b-846d-1024e3b0759f tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-4d31289a-25c3-42ed-a00e-832069018a20-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:23 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1c6c5260-3539-43cd-9e1f-e097b5c4e1fa tempest-GroupsV320Test-933129677 None] Group tempest-GroupsV320Test-Group-1361758499: creating
Jul 23 03:22:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1c6c5260-3539-43cd-9e1f-e097b5c4e1fa tempest-GroupsV320Test-933129677 None] Group tempest-GroupsV320Test-Group-1361758499: created successfully
Jul 23 03:22:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1c6c5260-3539-43cd-9e1f-e097b5c4e1fa tempest-GroupsV320Test-933129677 None] Create group completed successfully.
Jul 23 03:22:23 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.390s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Deleted volume successfully.
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-06830422-38a9-4901-8995-53afa576bee2 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "cinder-27418e13-0698-4e55-a618-e8241c3d5534-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Creating offline snapshot 79ed41b5-75e6-45cc-a677-a7688f15a895 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f6917-86df-43c5-8433-2fe6540441fa]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:24 devstack sudo[97423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:24 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Flow 'volume_create_manager' (f66aca08-e275-4a4e-8016-66484dbfd4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b721e8f3-2b7d-4a5c-8cfb-d3f3cdf48856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b721e8f3-2b7d-4a5c-8cfb-d3f3cdf48856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1015377327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252aa91d-5aba-4999-bb5b-cb68748d2b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699263e1e172450c9a05eb7808222cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:24Z,use_quota=True,user_id='8a7ac722b3e943319ec0efbcc497508c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590dd63b-79e6-4d9b-b853-49b4a6fad3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590dd63b-79e6-4d9b-b853-49b4a6fad3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08d5ccc-3e07-41b0-a6f9-dd8367e0fa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08d5ccc-3e07-41b0-a6f9-dd8367e0fa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252aa91d-5aba-4999-bb5b-cb68748d2b58', 'volume_name': 'volume-252aa91d-5aba-4999-bb5b-cb68748d2b58', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b49004e-a9ca-412f-82b6-8e56fd2864e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b49004e-a9ca-412f-82b6-8e56fd2864e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb60f6f9-9a52-4931-8bc1-d936d3a7fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Volume 252aa91d-5aba-4999-bb5b-cb68748d2b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252aa91d-5aba-4999-bb5b-cb68748d2b58', 'volume_size': 1}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:24 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.418s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:24 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 1G
Jul 23 03:22:24 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Flow 'volume_create_manager' (2e612669-70a6-4152-b6ab-9be1117b9f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fe3735-40d8-4d9a-8f19-7620fa03b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fe3735-40d8-4d9a-8f19-7620fa03b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1439115689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b91b6c5-b387-4640-99a1-030cd08ce4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a914314992814676baf109ead2bb7ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:24Z,use_quota=True,user_id='a39f7dcdc6a64f33a8e54a4014f08590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beb05ab-4e69-4a15-92f1-cebaec0a2672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beb05ab-4e69-4a15-92f1-cebaec0a2672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443c8821-ea50-4477-80dc-6937901c6c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443c8821-ea50-4477-80dc-6937901c6c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b91b6c5-b387-4640-99a1-030cd08ce4b5', 'volume_name': 'volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f180728-2b8c-4448-a7c7-5ce2938630b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f180728-2b8c-4448-a7c7-5ce2938630b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c656b8-0340-4b12-a929-4aae72a8cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Volume 0b91b6c5-b387-4640-99a1-030cd08ce4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5', 'volume_size': 1}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:24 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 1G" returned: 0 in 0.502s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:24 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895
Jul 23 03:22:24 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Created reservations ['80fa33cc-6324-46d0-abae-41e30cc0e954'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:25 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:25 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:25 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:25 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 is being set with open permissions: ugo+rw
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:25 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895
Jul 23 03:22:25 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:25 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.267s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:25 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895" returned: 0 in 0.239s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3ffed596-e01f-4382-aa38-aaf7829fd03f tempest-GroupsV320Test-933129677 None] Delete group completed successfully.
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.620s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1015377327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252aa91d-5aba-4999-bb5b-cb68748d2b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699263e1e172450c9a05eb7808222cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:24Z,use_quota=True,user_id='8a7ac722b3e943319ec0efbcc497508c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Creating volume 252aa91d-5aba-4999-bb5b-cb68748d2b58 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:25 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:25 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 1073741824
Jul 23 03:22:25 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c9a67c76-6907-46a8-acfc-5d62e6c8dbb0 tempest-SnapshotsActionsTest-687989460 None] Create snapshot completed successfully
Jul 23 03:22:25 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 1073741824" returned: 0 in 0.457s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:25 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58
Jul 23 03:22:25 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:26 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58" returned: 0 in 0.270s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1439115689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b91b6c5-b387-4640-99a1-030cd08ce4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a914314992814676baf109ead2bb7ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:24Z,use_quota=True,user_id='a39f7dcdc6a64f33a8e54a4014f08590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Creating volume 0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:26 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:26 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 1073741824
Jul 23 03:22:26 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb60f6f9-9a52-4931-8bc1-d936d3a7fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252aa91d-5aba-4999-bb5b-cb68748d2b58', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b04207-8049-4c70-8b02-8921038c9390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-79ed41b5-75e6-45cc-a677-a7688f15a895-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Volume volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 (252aa91d-5aba-4999-bb5b-cb68748d2b58): created successfully
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b04207-8049-4c70-8b02-8921038c9390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Flow 'volume_create_manager' (f66aca08-e275-4a4e-8016-66484dbfd4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-79ed41b5-75e6-45cc-a677-a7688f15a895-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-dad14d22-247e-4502-a58d-0e29572cb005 tempest-VolumeQuotasAdminTestJSON-504290014 None] Created volume successfully.
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-79ed41b5-75e6-45cc-a677-a7688f15a895" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-79ed41b5-75e6-45cc-a677-a7688f15a895" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Deleting offline snapshot 79ed41b5-75e6-45cc-a677-a7688f15a895 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] snapshot_file for this snap is: volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e384f83c-0104-4c7d-8cc2-b205af16ca76]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:26 devstack sudo[97458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895
Jul 23 03:22:26 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:26 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 1073741824" returned: 0 in 0.500s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:26 devstack sudo[97465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5
Jul 23 03:22:26 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:26 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895" returned: 0 in 0.378s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4999e6e5-566f-47a7-9542-b33b3b2e4e92]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:27 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:27 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:27 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5" returned: 0 in 0.261s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c656b8-0340-4b12-a929-4aae72a8cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1730f353-4f5f-4430-8dbf-4339c72271f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Volume volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 (0b91b6c5-b387-4640-99a1-030cd08ce4b5): created successfully
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1730f353-4f5f-4430-8dbf-4339c72271f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Flow 'volume_create_manager' (2e612669-70a6-4152-b6ab-9be1117b9f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-18400276-d7dc-45aa-88f3-0868d39d827b req-8aca101d-4521-4944-ad7f-593b43e3a26d tempest-VolumesSnapshotsTestJSON-1767381010 None] Created volume successfully.
Jul 23 03:22:27 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.401s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:27 devstack sudo[97476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895
Jul 23 03:22:27 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:27 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895" returned: 0 in 0.436s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:27 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895
Jul 23 03:22:27 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:28 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.79ed41b5-75e6-45cc-a677-a7688f15a895" returned: 0 in 0.355s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-79ed41b5-75e6-45cc-a677-a7688f15a895" released by "_delete_snapshot" :: held 1.702s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" released by "delete_snapshot" :: held 1.735s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Creating offline snapshot 3be1879b-9214-4f3c-8fa6-6ae38904d2ec of volume 0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3477a6-f5e6-4d4e-90d0-c6c4a08f0f00]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a6baee04-0b54-4578-bce2-3d27bec00590 tempest-VolumeQuotasAdminTestJSON-1862154269 None] Transfer volume completed successfully.
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Created reservations ['b09d9af8-d925-4071-908e-7d162e587659', 'af772bd6-a37d-44ed-ad6a-20d5ed17c286', '443bb3f0-c16d-4812-9c01-73fb234622d2', '4159dfec-b5da-491c-ab10-05a3e5490c56'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:28 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5
Jul 23 03:22:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Delete snapshot completed successfully.
Jul 23 03:22:28 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bc32e5e5-13ea-4892-8b99-350401b19f32 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-79ed41b5-75e6-45cc-a677-a7688f15a895-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:28 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5" returned: 0 in 0.607s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:28 devstack sudo[97490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec 1G
Jul 23 03:22:28 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Acquiring lock "cinder-252aa91d-5aba-4999-bb5b-cb68748d2b58-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Lock "cinder-252aa91d-5aba-4999-bb5b-cb68748d2b58-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Acquiring lock "cinder-quobyte-252aa91d-5aba-4999-bb5b-cb68748d2b58" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Lock "cinder-quobyte-252aa91d-5aba-4999-bb5b-cb68748d2b58" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc35dd6e-b308-4d5b-87fc-0445eb108452]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:29 devstack sudo[97528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58
Jul 23 03:22:29 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:29 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec 1G" returned: 0 in 0.632s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:29 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec
Jul 23 03:22:29 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:29 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58" returned: 0 in 0.495s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:29 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58
Jul 23 03:22:29 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:29 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec" returned: 0 in 0.353s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:29 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec is being set with open permissions: ugo+rw
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:29 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec
Jul 23 03:22:29 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:29 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-252aa91d-5aba-4999-bb5b-cb68748d2b58" returned: 0 in 0.274s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Lock "cinder-quobyte-252aa91d-5aba-4999-bb5b-cb68748d2b58" released by "delete_volume" :: held 0.833s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Created reservations ['82dd34e4-76cf-4f53-ac1a-d65b84bb2f3e', '5c6b3537-3907-4676-bca2-32a652edd0aa', '15f0b80b-def5-4d23-9212-4f1dcfaf37d4', '818ea467-d286-4f04-bd86-f0ba199db2e8'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:30 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:30 devstack sudo[97548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:30 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:30 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info
Jul 23 03:22:30 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:30 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.312s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:30 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Deleted volume successfully.
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info" returned: 0 in 0.320s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:30 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info is being set with open permissions: ugo+rw
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:30 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info
Jul 23 03:22:30 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-30f1c6fa-aa89-48be-b238-b8239da26fbc tempest-VolumeQuotasAdminTestJSON-1570733745 None] Lock "cinder-252aa91d-5aba-4999-bb5b-cb68748d2b58-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:30 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.info" returned: 0 in 0.274s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.708s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Creating offline snapshot f110c3bf-c419-4ede-8c56-2a82bf353bdc of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-e34d8aa2-acd6-4c12-9496-c33d6c102863 req-419e3b57-4615-4da8-aa9b-2c8dd4eb22d9 tempest-VolumesSnapshotsTestJSON-1767381010 None] Create snapshot completed successfully
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba347264-9d79-444c-8f9e-bbba939e0a68]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:31 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:31 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:31 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.422s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:31 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc 1G
Jul 23 03:22:31 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:31 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc 1G" returned: 0 in 0.530s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:31 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc
Jul 23 03:22:31 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "cinder-3be1879b-9214-4f3c-8fa6-6ae38904d2ec-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-3be1879b-9214-4f3c-8fa6-6ae38904d2ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "cinder-quobyte-0b91b6c5-b387-4640-99a1-030cd08ce4b5" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-quobyte-0b91b6c5-b387-4640-99a1-030cd08ce4b5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "cinder-quobyte-3be1879b-9214-4f3c-8fa6-6ae38904d2ec" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-quobyte-3be1879b-9214-4f3c-8fa6-6ae38904d2ec" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Deleting offline snapshot 3be1879b-9214-4f3c-8fa6-6ae38904d2ec of volume 0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] snapshot_file for this snap is: volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daa5ce8-4602-439c-87b3-202cc5936985]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:32 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:32 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc is being set with open permissions: ugo+rw
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:32 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc
Jul 23 03:22:32 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:32 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec
Jul 23 03:22:32 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:32 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc" returned: 0 in 0.301s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7cab54cc-d11b-4887-8170-d67a43c5118e tempest-SnapshotsActionsTest-687989460 None] Create snapshot completed successfully
Jul 23 03:22:32 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec" returned: 0 in 0.530s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c1297-62e2-44b6-aea2-6afe6af58e9e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:32 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5
Jul 23 03:22:32 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:33 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5" returned: 0 in 0.500s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:33 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec
Jul 23 03:22:33 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-f110c3bf-c419-4ede-8c56-2a82bf353bdc-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-f110c3bf-c419-4ede-8c56-2a82bf353bdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-f110c3bf-c419-4ede-8c56-2a82bf353bdc" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-f110c3bf-c419-4ede-8c56-2a82bf353bdc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Deleting offline snapshot f110c3bf-c419-4ede-8c56-2a82bf353bdc of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] snapshot_file for this snap is: volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5728be4b-6670-4b2a-b2ac-0a8f2d77f72b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:33 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec" returned: 0 in 0.466s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:33 devstack sudo[97594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec
Jul 23 03:22:33 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc
Jul 23 03:22:33 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:33 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:34 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5.3be1879b-9214-4f3c-8fa6-6ae38904d2ec" returned: 0 in 0.287s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-quobyte-3be1879b-9214-4f3c-8fa6-6ae38904d2ec" released by "_delete_snapshot" :: held 1.932s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-quobyte-0b91b6c5-b387-4640-99a1-030cd08ce4b5" released by "delete_snapshot" :: held 1.968s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:34 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc" returned: 0 in 0.549s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.quota [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Created reservations ['d65d7003-8cdc-421d-bb51-99c987096b3a', 'def1e66d-086f-4e6d-ab49-f7619f6a12ce', '85317272-80e0-46bf-a4cc-9f3bb4f5d41a', '6d738629-5959-4557-a999-550058dbf92e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba01f871-bcc1-4a59-ad27-2303c92de1f4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Delete snapshot completed successfully.
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-169e7e1a-4826-4a85-9a82-5414b00b5073 req-dad5ea7c-0de3-4a39-b45e-8f2c202ad025 tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-3be1879b-9214-4f3c-8fa6-6ae38904d2ec-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:34 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:34 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "cinder-0b91b6c5-b387-4640-99a1-030cd08ce4b5-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-0b91b6c5-b387-4640-99a1-030cd08ce4b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "cinder-quobyte-0b91b6c5-b387-4640-99a1-030cd08ce4b5" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-quobyte-0b91b6c5-b387-4640-99a1-030cd08ce4b5" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd113b0-6b56-444a-ae8b-9b340bd5a63c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:34 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.504s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:34 devstack sudo[97608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc
Jul 23 03:22:34 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:34 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5
Jul 23 03:22:34 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:35 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5" returned: 0 in 0.464s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:35 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5
Jul 23 03:22:35 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:35 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc" returned: 0 in 0.497s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:35 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc
Jul 23 03:22:35 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:35 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0b91b6c5-b387-4640-99a1-030cd08ce4b5" returned: 0 in 0.314s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-quobyte-0b91b6c5-b387-4640-99a1-030cd08ce4b5" released by "delete_volume" :: held 0.865s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.quota [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Created reservations ['f69f8619-868a-41fa-8c02-bf7316eff992', 'edf0495c-55f3-4dd3-98ff-ba937d338dbd', 'd8900ab0-36aa-42d6-b704-9d091e83ec1c', '0632df75-a631-4df9-9bac-35baef20a98b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:35 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.f110c3bf-c419-4ede-8c56-2a82bf353bdc" returned: 0 in 0.416s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-f110c3bf-c419-4ede-8c56-2a82bf353bdc" released by "_delete_snapshot" :: held 2.105s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" released by "delete_snapshot" :: held 2.138s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:35 devstack sudo[97625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:35 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Created reservations ['a4310988-625a-4b97-a10e-ba25d7ec5604', '7946aa3d-5f32-484e-9f0b-bbb2ccfdc864', '58563848-cb60-4e4f-bf4e-5ff06ce094ea', '0ac95cfb-27f9-41de-918d-7f179f8d671c'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:35 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Delete snapshot completed successfully.
Jul 23 03:22:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e6e99c45-756a-46f2-a9ee-6e88036618f5 tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-f110c3bf-c419-4ede-8c56-2a82bf353bdc-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:36 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.364s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:36 devstack cinder-volume[88344]: DEBUG cinder.manager [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Deleted volume successfully.
Jul 23 03:22:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-49364423-7df8-460d-8325-a870117f7412 req-fb1849d4-dafd-480a-8d76-9e6af06d712d tempest-VolumesSnapshotsTestJSON-1767381010 None] Lock "cinder-0b91b6c5-b387-4640-99a1-030cd08ce4b5-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Creating offline snapshot 712c5149-b537-42b7-a06a-e3be2e359b30 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f820bdf-33eb-43f2-9066-b7e6b5580270]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:37 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:37 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:37 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.441s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:37 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 1G
Jul 23 03:22:37 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:38 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 1G" returned: 0 in 0.602s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:38 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30
Jul 23 03:22:38 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:38 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30" returned: 0 in 0.356s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:38 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 is being set with open permissions: ugo+rw
Jul 23 03:22:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:38 devstack sudo[97643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30
Jul 23 03:22:38 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:38 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30" returned: 0 in 0.285s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ceb9babf-aa5b-4e01-9559-dc0ca1618f59 tempest-SnapshotsActionsTest-687989460 None] Create snapshot completed successfully
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-712c5149-b537-42b7-a06a-e3be2e359b30-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-712c5149-b537-42b7-a06a-e3be2e359b30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Acquiring lock "cinder-quobyte-712c5149-b537-42b7-a06a-e3be2e359b30" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-712c5149-b537-42b7-a06a-e3be2e359b30" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Deleting offline snapshot 712c5149-b537-42b7-a06a-e3be2e359b30 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] snapshot_file for this snap is: volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7563387d-74fb-49a6-8fea-d593dac1b0da]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:39 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30
Jul 23 03:22:39 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:39 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30" returned: 0 in 0.521s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b73ef2-5860-4825-a6b5-3368b927000f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Flow 'volume_create_manager' (4ae31d0c-0e61-44e4-9ce1-61af8ae8adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0add3b-8ca6-406e-a339-3a395d5d296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:40 devstack sudo[97652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:40 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0add3b-8ca6-406e-a339-3a395d5d296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1765864535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2847da7-2bc7-4f28-854a-65d6719c60d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211f554cb87445a4b8a43cb4a80fa97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:40Z,use_quota=True,user_id='472641fe35f04fcd8770bb549127dd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72dc470-e167-449e-9f32-d6c67a13d35f),volume_type_id=e72dc470-e167-449e-9f32-d6c67a13d35f)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb2c903-8304-42a5-bfc8-8c8b03b68b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb2c903-8304-42a5-bfc8-8c8b03b68b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f6b313-e2bb-4bb8-a507-95490b4b476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f6b313-e2bb-4bb8-a507-95490b4b476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2847da7-2bc7-4f28-854a-65d6719c60d3', 'volume_name': 'volume-a2847da7-2bc7-4f28-854a-65d6719c60d3', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccd826d-1bc0-4062-9339-183f0f8b4e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccd826d-1bc0-4062-9339-183f0f8b4e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d41439-ad5b-49f0-b473-c11750271e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Volume a2847da7-2bc7-4f28-854a-65d6719c60d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2847da7-2bc7-4f28-854a-65d6719c60d3', 'volume_size': 1}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1765864535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2847da7-2bc7-4f28-854a-65d6719c60d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211f554cb87445a4b8a43cb4a80fa97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:40Z,use_quota=True,user_id='472641fe35f04fcd8770bb549127dd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e72dc470-e167-449e-9f32-d6c67a13d35f),volume_type_id=e72dc470-e167-449e-9f32-d6c67a13d35f)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Creating volume a2847da7-2bc7-4f28-854a-65d6719c60d3 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:40 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:40 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 1073741824
Jul 23 03:22:40 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:40 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.508s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:40 devstack sudo[97660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30
Jul 23 03:22:40 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:40 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 1073741824" returned: 0 in 0.562s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:40 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3
Jul 23 03:22:40 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:40 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:41 devstack sudo[97670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30
Jul 23 03:22:41 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:41 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d41439-ad5b-49f0-b473-c11750271e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2847da7-2bc7-4f28-854a-65d6719c60d3', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f08ecfa-926c-46e9-a48b-8f3ded092800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Volume volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 (a2847da7-2bc7-4f28-854a-65d6719c60d3): created successfully
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f08ecfa-926c-46e9-a48b-8f3ded092800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Flow 'volume_create_manager' (4ae31d0c-0e61-44e4-9ce1-61af8ae8adf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4d75ff9d-6e41-46a2-a12c-9e7d981e3b09 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Created volume successfully.
Jul 23 03:22:41 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.712c5149-b537-42b7-a06a-e3be2e359b30" returned: 0 in 0.320s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-712c5149-b537-42b7-a06a-e3be2e359b30" released by "_delete_snapshot" :: held 1.927s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" released by "delete_snapshot" :: held 1.951s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Created reservations ['a32b8560-a864-4641-8c9f-051e3b05589a', '97049891-6243-41c2-81c7-5b2015de7fb7', 'ca0bc906-9547-4636-9b81-293a957f2a90', '4fa7fdc7-023f-4d44-854a-e0f94dcfe0b4'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Delete snapshot completed successfully.
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2dbe97-0cd2-4b29-9f52-d63ca17c4cfd tempest-SnapshotsActionsTest-1298853125 None] Lock "cinder-712c5149-b537-42b7-a06a-e3be2e359b30-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:41 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Flow 'volume_create_manager' (ac27f413-951e-428e-a3f3-db9266a9cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e40361-dced-4738-a14b-bad10bf49bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "cinder-2df7b046-5cb3-4b03-a16e-320cfd7cb012-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e40361-dced-4738-a14b-bad10bf49bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1982935876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8111b8dd-38f9-42f3-b8bf-49923b355aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de63129e3c4766a52647d31c65d513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='a7b5907019d341d1908e913da7f339c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b5e00e3-e7b7-4d20-8d7e-4fcebedc4e42),volume_type_id=8b5e00e3-e7b7-4d20-8d7e-4fcebedc4e42)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06469595-eb83-4758-8783-06801cc0c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06469595-eb83-4758-8783-06801cc0c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a3d1d5-dafb-431f-8a07-dc6fe3a4ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a3d1d5-dafb-431f-8a07-dc6fe3a4ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8111b8dd-38f9-42f3-b8bf-49923b355aef', 'volume_name': 'volume-8111b8dd-38f9-42f3-b8bf-49923b355aef', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51106145-7fbf-41b6-b6af-e12ad1461ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51106145-7fbf-41b6-b6af-e12ad1461ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4839896-0b2e-4bdc-989e-cd22ac33f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Volume 8111b8dd-38f9-42f3-b8bf-49923b355aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8111b8dd-38f9-42f3-b8bf-49923b355aef', 'volume_size': 1}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1982935876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8111b8dd-38f9-42f3-b8bf-49923b355aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de63129e3c4766a52647d31c65d513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='a7b5907019d341d1908e913da7f339c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b5e00e3-e7b7-4d20-8d7e-4fcebedc4e42),volume_type_id=8b5e00e3-e7b7-4d20-8d7e-4fcebedc4e42)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Creating volume 8111b8dd-38f9-42f3-b8bf-49923b355aef {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:42 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-2df7b046-5cb3-4b03-a16e-320cfd7cb012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:42 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef 1073741824
Jul 23 03:22:42 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Flow 'volume_create_manager' (2ce975ed-b7e8-4733-be3e-d2e728de480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c1245e-2fcf-4d87-b119-9033735dbeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "cinder-quobyte-2df7b046-5cb3-4b03-a16e-320cfd7cb012" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c1245e-2fcf-4d87-b119-9033735dbeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-739301746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91299a5f-157e-4a6c-97d6-c8651fddd584,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df28ed8558e244ebb0f1051b711c0089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='2059bb22f792411ea226ab7598ad76e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283c99ed-b34d-45dc-bc26-4d03bf2b27a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283c99ed-b34d-45dc-bc26-4d03bf2b27a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e246e2-979c-4655-bb33-21d83f4d53ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e246e2-979c-4655-bb33-21d83f4d53ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91299a5f-157e-4a6c-97d6-c8651fddd584', 'volume_name': 'volume-91299a5f-157e-4a6c-97d6-c8651fddd584', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef2d42e-44c2-4ad3-ae40-27bb4205f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef2d42e-44c2-4ad3-ae40-27bb4205f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3edc864-bdb8-42fc-bfde-81b3119cef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Volume 91299a5f-157e-4a6c-97d6-c8651fddd584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91299a5f-157e-4a6c-97d6-c8651fddd584', 'volume_size': 1}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-quobyte-2df7b046-5cb3-4b03-a16e-320cfd7cb012" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Deleting offline snapshot 2df7b046-5cb3-4b03-a16e-320cfd7cb012 of volume 40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] snapshot_file for this snap is: volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a3717-7dc0-4dd2-b081-2d8fc790ed8b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:42 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:42 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:42 devstack sudo[97680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:42 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:42 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef 1073741824" returned: 0 in 0.530s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:42 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1badd74a-7d74-4e3f-88b5-ff6815d12cc5 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Retype volume completed successfully.
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:42 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef
Jul 23 03:22:42 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:42 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.499s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c13fb3-c71f-4546-802a-0cec19dfcb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ccbc9-0723-44ce-bc33-1bb07bb16598]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:42 devstack sudo[97694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72
Jul 23 03:22:42 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:42 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef" returned: 0 in 0.268s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-739301746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91299a5f-157e-4a6c-97d6-c8651fddd584,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df28ed8558e244ebb0f1051b711c0089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='2059bb22f792411ea226ab7598ad76e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Creating volume 91299a5f-157e-4a6c-97d6-c8651fddd584 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:42 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4839896-0b2e-4bdc-989e-cd22ac33f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8111b8dd-38f9-42f3-b8bf-49923b355aef', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:42 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584 1073741824
Jul 23 03:22:42 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd1afdc-49e5-4b2f-b73e-4d68c986a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Volume volume-8111b8dd-38f9-42f3-b8bf-49923b355aef (8111b8dd-38f9-42f3-b8bf-49923b355aef): created successfully
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd1afdc-49e5-4b2f-b73e-4d68c986a254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Flow 'volume_create_manager' (ac27f413-951e-428e-a3f3-db9266a9cf11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1ddf4b77-1572-4b71-a053-fd2952f99888 tempest-VolumeTypesAccessTest-697972710 None] Created volume successfully.
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Acquiring lock "cinder-a2847da7-2bc7-4f28-854a-65d6719c60d3-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "cinder-a2847da7-2bc7-4f28-854a-65d6719c60d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Acquiring lock "cinder-quobyte-a2847da7-2bc7-4f28-854a-65d6719c60d3" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:43 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "cinder-quobyte-a2847da7-2bc7-4f28-854a-65d6719c60d3" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72" returned: 0 in 0.441s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e10a9b-881a-4a5a-99dd-9694a55a124d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:43 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:43 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:43 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3
Jul 23 03:22:43 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:43 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584 1073741824" returned: 0 in 0.532s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:43 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584
Jul 23 03:22:43 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:43 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.390s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:43 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012
Jul 23 03:22:43 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:43 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Acquiring lock "cinder-8111b8dd-38f9-42f3-b8bf-49923b355aef-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3" returned: 0 in 0.482s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Lock "cinder-8111b8dd-38f9-42f3-b8bf-49923b355aef-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:43 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:43 devstack sudo[97722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3
Jul 23 03:22:43 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584" returned: 0 in 0.316s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3edc864-bdb8-42fc-bfde-81b3119cef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91299a5f-157e-4a6c-97d6-c8651fddd584', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51ae332-672b-4845-8e5b-b26b2cc473bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Volume volume-91299a5f-157e-4a6c-97d6-c8651fddd584 (91299a5f-157e-4a6c-97d6-c8651fddd584): created successfully
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51ae332-672b-4845-8e5b-b26b2cc473bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Flow 'volume_create_manager' (2ce975ed-b7e8-4733-be3e-d2e728de480d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Acquiring lock "cinder-quobyte-8111b8dd-38f9-42f3-b8bf-49923b355aef" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-8e2ee1af-31de-4ad2-91ea-ff4501f0b107 req-04e7cafe-1efe-4ac4-b306-c29ccc6e368b tempest-VolumesGetTestJSON-43615123 None] Created volume successfully.
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Lock "cinder-quobyte-8111b8dd-38f9-42f3-b8bf-49923b355aef" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99c2446-297d-409b-b934-c1b1c5d78238]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:43 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72.2df7b046-5cb3-4b03-a16e-320cfd7cb012" returned: 0 in 0.349s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-quobyte-2df7b046-5cb3-4b03-a16e-320cfd7cb012" released by "_delete_snapshot" :: held 1.792s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" released by "delete_snapshot" :: held 1.865s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:44 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef
Jul 23 03:22:44 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Created reservations ['48fbed0f-d8dd-4384-873e-ce252d02c528', 'ec1f50d1-1cfe-4d9d-876e-54fab07bc3ba', 'a5358386-5182-4868-b53d-c3cd66bdb58f', '20f2200c-61c9-4261-bd21-cb210c720e69'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:44 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2847da7-2bc7-4f28-854a-65d6719c60d3" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "cinder-quobyte-a2847da7-2bc7-4f28-854a-65d6719c60d3" released by "delete_volume" :: held 0.917s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Delete snapshot completed successfully.
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-96269b76-5c9d-4549-880e-2c6e502b3291 tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-2df7b046-5cb3-4b03-a16e-320cfd7cb012-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:44 devstack cinder-volume[88344]: WARNING cinder.quota [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:44 devstack cinder-volume[88344]: WARNING cinder.quota [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Created reservations ['fa773850-e630-45f6-89c2-758d7193fe97', '6c7dfef2-1447-498f-a758-25a919874b99', '2b5f5bf7-db5d-4b37-8df6-5cb17473d332', '204d536e-c9f3-4d75-86aa-a7862979fe98'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "cinder-40c13fb3-c71f-4546-802a-0cec19dfcb72-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-40c13fb3-c71f-4546-802a-0cec19dfcb72-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:44 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:44 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:44 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef" returned: 0 in 0.430s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:44 devstack sudo[97733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef
Jul 23 03:22:44 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5a825-b032-406e-8ee6-8c3d40a08d76]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:44 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72
Jul 23 03:22:44 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:44 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.266s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Deleted volume successfully.
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e1fd338-6fc1-461a-ad56-678c4863fff7 tempest-VolumeRetypeWithoutMigrationTest-766510473 None] Lock "cinder-a2847da7-2bc7-4f28-854a-65d6719c60d3-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:44 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8111b8dd-38f9-42f3-b8bf-49923b355aef" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Lock "cinder-quobyte-8111b8dd-38f9-42f3-b8bf-49923b355aef" released by "delete_volume" :: held 0.757s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:44 devstack cinder-volume[88344]: WARNING cinder.quota [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1873651359 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1873651359, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:44 devstack cinder-volume[88344]: WARNING cinder.quota [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1873651359 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1873651359, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Created reservations ['59c7a802-0bdf-409c-b621-17159476ccf7', 'a8cd0bf1-3db9-421f-b8e6-e90746a5362c', '7bb52d1f-f928-4c9b-8517-1c1bc037a926', '5792f554-dc0a-41ac-8ac2-09be6dff8eda'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:44 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:44 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:44 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72" returned: 0 in 0.473s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:45 devstack sudo[97745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72
Jul 23 03:22:45 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:45 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.305s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Deleted volume successfully.
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5be3f0a1-bae1-4943-b2dc-aa7a6d0d9036 tempest-VolumeTypesAccessTest-697972710 None] Lock "cinder-8111b8dd-38f9-42f3-b8bf-49923b355aef-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:45 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-40c13fb3-c71f-4546-802a-0cec19dfcb72" returned: 0 in 0.314s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-quobyte-40c13fb3-c71f-4546-802a-0cec19dfcb72" released by "delete_volume" :: held 0.877s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Created reservations ['7ed986c9-1e55-4abf-bbe1-67ff34748d6d', 'aa0c2adf-db2a-47cf-8d9e-ab979065b1b3', 'cf7647b6-2bd2-4a15-bf68-accb1e1c5538', 'a91361db-8fad-4fa4-995d-4fec2cf08344'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Acquiring lock "cinder-91299a5f-157e-4a6c-97d6-c8651fddd584-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Lock "cinder-91299a5f-157e-4a6c-97d6-c8651fddd584-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Acquiring lock "cinder-quobyte-91299a5f-157e-4a6c-97d6-c8651fddd584" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Lock "cinder-quobyte-91299a5f-157e-4a6c-97d6-c8651fddd584" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9615298b-b757-461b-ae05-68860a5ea216]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:45 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:45 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:45 devstack sudo[97750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584
Jul 23 03:22:45 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:45 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.351s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:45 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Deleted volume successfully.
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-94de0c8c-c604-4c2c-ba6a-0f16b0b6959e tempest-SnapshotsActionsTest-687989460 None] Lock "cinder-40c13fb3-c71f-4546-802a-0cec19dfcb72-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:46 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584" returned: 0 in 0.474s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:46 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584
Jul 23 03:22:46 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:46 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-91299a5f-157e-4a6c-97d6-c8651fddd584" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Lock "cinder-quobyte-91299a5f-157e-4a6c-97d6-c8651fddd584" released by "delete_volume" :: held 0.841s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.quota [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Created reservations ['871420a0-aa8a-4d98-8381-9822bdabbbde', 'c3a03b29-cbbb-4e4a-a280-2529dbe5add5', '5a2461d8-ea05-4aa0-ad71-cd0e1c58b09d', 'f4201635-8218-4913-bdb6-1d8971466625'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:46 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:46 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:46 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.259s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.manager [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Deleted volume successfully.
Jul 23 03:22:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-9d4b066d-de8a-495e-a9aa-fcda7f33bc9d req-cc5fcc4e-1d9f-494b-a9be-cb795d23fc1e tempest-VolumesGetTestJSON-43615123 None] Lock "cinder-91299a5f-157e-4a6c-97d6-c8651fddd584-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Flow 'volume_create_manager' (99b69b84-2098-4236-a4b2-5965928da922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a167f349-a3f5-44f0-8ddf-5a08f1c7f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a167f349-a3f5-44f0-8ddf-5a08f1c7f38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1655263251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb33419-e9ea-4db0-84c4-36ba391b87aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd84029f4644530ab58f0ac4c517f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:55Z,use_quota=True,user_id='25220975ed604dfe88c7b31e0d1c3e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd08f6cc-109a-4005-ab63-1e2bf682e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd08f6cc-109a-4005-ab63-1e2bf682e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83ff5ec-b908-484b-946b-fe5f566f52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83ff5ec-b908-484b-946b-fe5f566f52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb33419-e9ea-4db0-84c4-36ba391b87aa', 'volume_name': 'volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb97d1d-6b13-4f0a-9428-1433de69b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb97d1d-6b13-4f0a-9428-1433de69b729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b4ee64-d529-4a75-8b9f-b7fc468481de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:54 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Volume 3fb33419-e9ea-4db0-84c4-36ba391b87aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa', 'volume_size': 1}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1655263251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb33419-e9ea-4db0-84c4-36ba391b87aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd84029f4644530ab58f0ac4c517f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:55Z,use_quota=True,user_id='25220975ed604dfe88c7b31e0d1c3e25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Creating volume 3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:54 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:54 devstack sudo[97770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa 1073741824
Jul 23 03:22:54 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:55 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa 1073741824" returned: 0 in 0.610s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:55 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa
Jul 23 03:22:55 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:55 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa" returned: 0 in 0.299s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b4ee64-d529-4a75-8b9f-b7fc468481de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1127cb3c-e50c-49dd-b5ef-447a9e1f789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:55 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Volume volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa (3fb33419-e9ea-4db0-84c4-36ba391b87aa): created successfully
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1127cb3c-e50c-49dd-b5ef-447a9e1f789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Flow 'volume_create_manager' (99b69b84-2098-4236-a4b2-5965928da922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:55 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a7d4ea70-bdc1-4249-9f9f-8dfc0c236075 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Created volume successfully.
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Flow 'volume_create_manager' (fb309289-f968-4768-afd7-9acf8d46cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3e6e43-c06e-47c5-950b-1d6ea9680cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3e6e43-c06e-47c5-950b-1d6ea9680cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-284843861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1b9582-9f92-4842-b63e-4a11629603fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3626c78b9c4c83869ad588580289c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:56Z,use_quota=True,user_id='3c514f3273854383a7af3ba16ce60ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcc0f72-4aa1-458c-b711-278fd41841ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcc0f72-4aa1-458c-b711-278fd41841ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8197d6d-4347-4a13-9628-9bdfc19d43bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8197d6d-4347-4a13-9628-9bdfc19d43bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1b9582-9f92-4842-b63e-4a11629603fd', 'volume_name': 'volume-0c1b9582-9f92-4842-b63e-4a11629603fd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e856bb-9599-4394-93a4-0ab98f804232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e856bb-9599-4394-93a4-0ab98f804232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5839ce-d990-4237-a82e-855aa2e186a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:56 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Volume 0c1b9582-9f92-4842-b63e-4a11629603fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1b9582-9f92-4842-b63e-4a11629603fd', 'volume_size': 1}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-284843861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1b9582-9f92-4842-b63e-4a11629603fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3626c78b9c4c83869ad588580289c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:56Z,use_quota=True,user_id='3c514f3273854383a7af3ba16ce60ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Creating volume 0c1b9582-9f92-4842-b63e-4a11629603fd {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:22:56 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:56 devstack sudo[97779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd 1073741824
Jul 23 03:22:56 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:56 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd 1073741824" returned: 0 in 0.544s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:56 devstack sudo[97785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd
Jul 23 03:22:56 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:57 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd" returned: 0 in 0.278s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Creating offline snapshot 0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 of volume 3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5839ce-d990-4237-a82e-855aa2e186a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1b9582-9f92-4842-b63e-4a11629603fd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d19239d-c2c7-4099-b99a-0662cad5d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4488d90-7b6d-48aa-935b-cf21bac57f7a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:57 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Volume volume-0c1b9582-9f92-4842-b63e-4a11629603fd (0c1b9582-9f92-4842-b63e-4a11629603fd): created successfully
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d19239d-c2c7-4099-b99a-0662cad5d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Flow 'volume_create_manager' (fb309289-f968-4768-afd7-9acf8d46cce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:22:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d1bcca90-9bdd-4da1-bd94-2be338a02673 tempest-VolumesServicesTestJSON-33293460 None] Created volume successfully.
Jul 23 03:22:57 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa
Jul 23 03:22:57 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:57 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa" returned: 0 in 0.481s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:57 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 1G
Jul 23 03:22:57 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:58 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 1G" returned: 0 in 0.479s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:58 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339
Jul 23 03:22:58 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Acquiring lock "cinder-0c1b9582-9f92-4842-b63e-4a11629603fd-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:58 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" returned: 0 in 0.345s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:58 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 is being set with open permissions: ugo+rw
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Lock "cinder-0c1b9582-9f92-4842-b63e-4a11629603fd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:58 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339
Jul 23 03:22:58 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Acquiring lock "cinder-quobyte-0c1b9582-9f92-4842-b63e-4a11629603fd" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Lock "cinder-quobyte-0c1b9582-9f92-4842-b63e-4a11629603fd" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4b41c-b0d7-41ae-9595-3770c527049d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:58 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd
Jul 23 03:22:58 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:58 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" returned: 0 in 0.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:58 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:58 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:58 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info
Jul 23 03:22:58 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:59 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.426s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 8 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:22:59 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd" returned: 0 in 0.597s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:59 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info" returned: 0 in 0.370s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:59 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info is being set with open permissions: ugo+rw
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:59 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd
Jul 23 03:22:59 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:59 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info
Jul 23 03:22:59 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:22:59 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.info" returned: 0 in 0.334s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:59 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0c1b9582-9f92-4842-b63e-4a11629603fd" returned: 0 in 0.415s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Lock "cinder-quobyte-0c1b9582-9f92-4842-b63e-4a11629603fd" released by "delete_volume" :: held 1.093s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:22:59 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-27d407da-4a9f-4020-b74d-29d4b048b55d tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Create snapshot completed successfully
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Created reservations ['d82ed85a-e7e6-480c-8ccc-056fa1365b9c', '5b16a85e-9dba-4718-9a07-00e5fbc11a32', '6c523ab4-9a39-4ff6-8978-3b0c768a6363', 'ab61eb7c-7e71-4adb-a7c6-99eb9ec8599e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:22:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:22:59 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:22:59 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:00 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.280s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:00 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Deleted volume successfully.
Jul 23 03:23:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a6c019d4-596b-4745-98b9-852ddae76963 tempest-VolumesServicesTestJSON-33293460 None] Lock "cinder-0c1b9582-9f92-4842-b63e-4a11629603fd-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "cinder-0cbc4e5f-3849-437a-bf3d-e3dd33ea7339-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-0cbc4e5f-3849-437a-bf3d-e3dd33ea7339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "cinder-quobyte-3fb33419-e9ea-4db0-84c4-36ba391b87aa" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-quobyte-3fb33419-e9ea-4db0-84c4-36ba391b87aa" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "cinder-quobyte-0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-quobyte-0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Deleting offline snapshot 0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 of volume 3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] snapshot_file for this snap is: volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a54d08-6c3a-4aff-bf2f-11b15656ae10]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:01 devstack sudo[97827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339
Jul 23 03:23:01 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:01 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" returned: 0 in 0.436s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac7770-1efd-4a40-ae86-aa3f6d053cc2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:02 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa
Jul 23 03:23:02 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:02 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa" returned: 0 in 0.495s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:02 devstack sudo[97838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339
Jul 23 03:23:02 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:02 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" returned: 0 in 0.442s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:02 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339
Jul 23 03:23:02 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:03 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa.0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" returned: 0 in 0.326s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-quobyte-0cbc4e5f-3849-437a-bf3d-e3dd33ea7339" released by "_delete_snapshot" :: held 1.873s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-quobyte-3fb33419-e9ea-4db0-84c4-36ba391b87aa" released by "delete_snapshot" :: held 1.908s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Created reservations ['aee79c19-534f-403b-849e-79ff218bcacf', '670898ac-c43d-4bc4-9ae3-2679eb3849d9', '9e0d0cec-b3f8-4857-80d7-cdd779f439ca', '0c5c0b73-6db5-4d97-8b85-119cfb8353ae'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Delete snapshot completed successfully.
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1a2296d4-4384-4006-b717-daba2680d931 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-0cbc4e5f-3849-437a-bf3d-e3dd33ea7339-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "cinder-3fb33419-e9ea-4db0-84c4-36ba391b87aa-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-3fb33419-e9ea-4db0-84c4-36ba391b87aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "cinder-quobyte-3fb33419-e9ea-4db0-84c4-36ba391b87aa" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-quobyte-3fb33419-e9ea-4db0-84c4-36ba391b87aa" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6780b8-6764-4804-9e58-f995ca7e8e6a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:04 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa
Jul 23 03:23:04 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Flow 'volume_create_manager' (e1b727f4-2fe7-483f-80c7-c5363717de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:04 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac2cf94-c11d-42b7-b7dd-e3b9156a4d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa" returned: 0 in 0.614s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac2cf94-c11d-42b7-b7dd-e3b9156a4d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047704895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768b988f-d923-45e1-803c-ec4f4c77cb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104af7edaae345668b3b3ede56060241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:04Z,use_quota=True,user_id='7d36905038854165a3d31781e1153f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:04 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa
Jul 23 03:23:04 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af459bac-7a9c-4bb1-8fd6-593f2a0d457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af459bac-7a9c-4bb1-8fd6-593f2a0d457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb3917b-f39a-4a6e-b9e9-270d22aa782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb3917b-f39a-4a6e-b9e9-270d22aa782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768b988f-d923-45e1-803c-ec4f4c77cb0b', 'volume_name': 'volume-768b988f-d923-45e1-803c-ec4f4c77cb0b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71144ae0-1520-4649-9ec0-681891ae8611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71144ae0-1520-4649-9ec0-681891ae8611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325d823f-f1bd-451f-9398-cf7c2c9e292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:04 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Volume 768b988f-d923-45e1-803c-ec4f4c77cb0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768b988f-d923-45e1-803c-ec4f4c77cb0b', 'volume_size': 1}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047704895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768b988f-d923-45e1-803c-ec4f4c77cb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104af7edaae345668b3b3ede56060241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:04Z,use_quota=True,user_id='7d36905038854165a3d31781e1153f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Creating volume 768b988f-d923-45e1-803c-ec4f4c77cb0b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:04 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:04 devstack sudo[97856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b 1073741824
Jul 23 03:23:04 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:04 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3fb33419-e9ea-4db0-84c4-36ba391b87aa" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-quobyte-3fb33419-e9ea-4db0-84c4-36ba391b87aa" released by "delete_volume" :: held 1.031s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:04 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Created reservations ['335c8904-073e-4401-9ca5-8d6688654d56', '6f5c4f33-dc66-4533-9f9e-8d1bd2a7ec4f', '604f3284-2346-45d8-bdec-902e7decacf2', '22ac74fe-a28d-40fb-9891-4172f46f82cf'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:05 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:05 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:05 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b 1073741824" returned: 0 in 0.617s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:05 devstack sudo[97866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b
Jul 23 03:23:05 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:05 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.296s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Deleted volume successfully.
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b04d756-a017-49f4-b84f-052e3fa2fa97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1740282854 None] Lock "cinder-3fb33419-e9ea-4db0-84c4-36ba391b87aa-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:05 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b" returned: 0 in 0.307s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325d823f-f1bd-451f-9398-cf7c2c9e292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768b988f-d923-45e1-803c-ec4f4c77cb0b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cd3703-fa47-4823-b076-855acc94a0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:05 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Volume volume-768b988f-d923-45e1-803c-ec4f4c77cb0b (768b988f-d923-45e1-803c-ec4f4c77cb0b): created successfully
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cd3703-fa47-4823-b076-855acc94a0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Flow 'volume_create_manager' (e1b727f4-2fe7-483f-80c7-c5363717de6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f1b98ff9-ec68-42a3-adfe-3e8c1bf62866 tempest-VolumesTransfersTest-308965792 None] Created volume successfully.
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Flow 'volume_create_manager' (20bd5067-42c6-421f-b6bf-042f54390799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacbf367-2923-4999-9d4e-f2e2f68c707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacbf367-2923-4999-9d4e-f2e2f68c707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1945059132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf3376f-8941-4eab-aca8-e0706eefeb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025b20efe09b41ca959fdf6da9798150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:06Z,use_quota=True,user_id='79be04e31d9d4c27b07d90008e42ef5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd12c90-7f08-4b35-801b-3e99e28dbda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd12c90-7f08-4b35-801b-3e99e28dbda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe69d87-d1bf-4680-8f8c-7d8315d62004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe69d87-d1bf-4680-8f8c-7d8315d62004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf3376f-8941-4eab-aca8-e0706eefeb08', 'volume_name': 'volume-ecf3376f-8941-4eab-aca8-e0706eefeb08', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d56b3f5-456a-4d0d-950d-ced9807deabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d56b3f5-456a-4d0d-950d-ced9807deabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c0f7bf-644f-46ae-ba0d-d3e261cd3944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:06 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Volume ecf3376f-8941-4eab-aca8-e0706eefeb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf3376f-8941-4eab-aca8-e0706eefeb08', 'volume_size': 1}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1945059132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf3376f-8941-4eab-aca8-e0706eefeb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025b20efe09b41ca959fdf6da9798150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:06Z,use_quota=True,user_id='79be04e31d9d4c27b07d90008e42ef5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Creating volume ecf3376f-8941-4eab-aca8-e0706eefeb08 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:06 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:06 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 1073741824
Jul 23 03:23:06 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:07 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 1073741824" returned: 0 in 0.564s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:07 devstack sudo[97876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08
Jul 23 03:23:07 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:07 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c0f7bf-644f-46ae-ba0d-d3e261cd3944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf3376f-8941-4eab-aca8-e0706eefeb08', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdcee07-6350-4ed5-87c9-185a82d8ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:07 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Volume volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 (ecf3376f-8941-4eab-aca8-e0706eefeb08): created successfully
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdcee07-6350-4ed5-87c9-185a82d8ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Flow 'volume_create_manager' (20bd5067-42c6-421f-b6bf-042f54390799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6bff7deb-b6d1-4bd6-8e84-8f7194e0da85 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Created volume successfully.
Jul 23 03:23:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a577b76b-e3c5-4e8b-a495-983e1c72c2e1 tempest-VolumesTransfersTest-1733704458 None] Transfer volume completed successfully.
Jul 23 03:23:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Acquiring lock "cinder-768b988f-d923-45e1-803c-ec4f4c77cb0b-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-768b988f-d923-45e1-803c-ec4f4c77cb0b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Acquiring lock "cinder-quobyte-768b988f-d923-45e1-803c-ec4f4c77cb0b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-quobyte-768b988f-d923-45e1-803c-ec4f4c77cb0b" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e0c709-c211-41e8-a046-f000883fa60e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:08 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b
Jul 23 03:23:08 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:09 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b" returned: 0 in 0.492s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:09 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b
Jul 23 03:23:09 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:09 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-768b988f-d923-45e1-803c-ec4f4c77cb0b" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-quobyte-768b988f-d923-45e1-803c-ec4f4c77cb0b" released by "delete_volume" :: held 0.886s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Created reservations ['ad24d57b-3ae3-4566-8ce1-7ab60f01abbe', '1c7b1cd6-75d0-485d-81a8-cd1c068d56d0', '85022594-a85f-472b-9420-01f1083ed4d6', '99499273-0d84-4fc9-bad3-4fd695827b55'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:09 devstack sudo[97888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:09 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:09 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.420s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:09 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Deleted volume successfully.
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e99d5f36-b686-4995-a5d9-8d6e8a885767 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-768b988f-d923-45e1-803c-ec4f4c77cb0b-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Acquiring lock "cinder-ecf3376f-8941-4eab-aca8-e0706eefeb08-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "cinder-ecf3376f-8941-4eab-aca8-e0706eefeb08-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Acquiring lock "cinder-quobyte-ecf3376f-8941-4eab-aca8-e0706eefeb08" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "cinder-quobyte-ecf3376f-8941-4eab-aca8-e0706eefeb08" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcdf80-db94-43bc-a974-3b156fe5845a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:10 devstack sudo[97891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08
Jul 23 03:23:10 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Flow 'volume_create_manager' (63637c96-61f7-4ade-ad3d-4dd762e36d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c48e7bc-2076-44b2-8e6c-dab107a9caa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c48e7bc-2076-44b2-8e6c-dab107a9caa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1237195305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8ae239-82b7-4b80-b33c-0c78054bec7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104af7edaae345668b3b3ede56060241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:10Z,use_quota=True,user_id='7d36905038854165a3d31781e1153f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2779a4-2210-4e41-a4cd-1bf0d31a2959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2779a4-2210-4e41-a4cd-1bf0d31a2959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4158273-833c-4e65-8e4c-8b2d2d75a033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4158273-833c-4e65-8e4c-8b2d2d75a033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8ae239-82b7-4b80-b33c-0c78054bec7a', 'volume_name': 'volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c169f4-e93d-4686-9d7d-1737d00ed3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c169f4-e93d-4686-9d7d-1737d00ed3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a51f514-a49e-4950-ad7c-7d6646e78cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:10 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Volume 3f8ae239-82b7-4b80-b33c-0c78054bec7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a', 'volume_size': 1}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1237195305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8ae239-82b7-4b80-b33c-0c78054bec7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104af7edaae345668b3b3ede56060241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:10Z,use_quota=True,user_id='7d36905038854165a3d31781e1153f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Creating volume 3f8ae239-82b7-4b80-b33c-0c78054bec7a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:10 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:10 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a 1073741824
Jul 23 03:23:10 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:10 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08" returned: 0 in 0.522s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:10 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08
Jul 23 03:23:10 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:11 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ecf3376f-8941-4eab-aca8-e0706eefeb08" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "cinder-quobyte-ecf3376f-8941-4eab-aca8-e0706eefeb08" released by "delete_volume" :: held 0.954s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=209,cinder:SELECT=163,cinder:INSERT=57,cinder:DELETE=17 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:23:11 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a 1073741824" returned: 0 in 0.633s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Created reservations ['70e817c9-7c4a-404e-88dc-cc8845f72680', '4a119226-220c-4452-9024-371f215917f6', 'a418524f-f059-49f0-9999-487e2c6431e0', 'dbd767d7-84a1-4c4e-8c09-755320e88a76'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:11 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a
Jul 23 03:23:11 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:11 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:11 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:11 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a51f514-a49e-4950-ad7c-7d6646e78cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6a193-a1d1-4a51-bdd7-d024df5644a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Volume volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a (3f8ae239-82b7-4b80-b33c-0c78054bec7a): created successfully
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6a193-a1d1-4a51-bdd7-d024df5644a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Flow 'volume_create_manager' (63637c96-61f7-4ade-ad3d-4dd762e36d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c1b82538-8393-4204-ad8b-45f5cada5fe7 tempest-VolumesTransfersTest-308965792 None] Created volume successfully.
Jul 23 03:23:11 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Deleted volume successfully.
Jul 23 03:23:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9665d160-e2f1-44b5-8890-9ac1410bb3e4 tempest-VolumeQuotasNegativeTestJSON-1305437889 None] Lock "cinder-ecf3376f-8941-4eab-aca8-e0706eefeb08-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Acquiring lock "cinder-3f8ae239-82b7-4b80-b33c-0c78054bec7a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-3f8ae239-82b7-4b80-b33c-0c78054bec7a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Acquiring lock "cinder-quobyte-3f8ae239-82b7-4b80-b33c-0c78054bec7a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-quobyte-3f8ae239-82b7-4b80-b33c-0c78054bec7a" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b00c6bc-7807-4f21-bf8f-0345f5175cca]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:13 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a
Jul 23 03:23:13 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:13 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a" returned: 0 in 0.526s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:13 devstack sudo[97917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a
Jul 23 03:23:13 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:14 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3f8ae239-82b7-4b80-b33c-0c78054bec7a" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-quobyte-3f8ae239-82b7-4b80-b33c-0c78054bec7a" released by "delete_volume" :: held 0.965s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Created reservations ['a80cee5d-17ac-4745-840f-374895bf7aca', '92cf5093-eaac-46bd-9f0f-3e8cbccca551', '168294b8-5aae-4ce7-96b3-ec5f8202dddd', '50e8df25-67b4-4f1c-8e57-957057b12676'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:14 devstack sudo[97920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:14 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:14 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.423s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Deleted volume successfully.
Jul 23 03:23:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d635cf2e-ac00-49a0-a18f-eee0274adc75 tempest-VolumesTransfersTest-1762517499 None] Lock "cinder-3f8ae239-82b7-4b80-b33c-0c78054bec7a-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Flow 'volume_create_manager' (923a8783-f6c2-4d1a-8df8-20eefb5d3d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b386385-a7fe-4dac-8243-336778a1baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b386385-a7fe-4dac-8243-336778a1baa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2067949943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2974793-9af9-4490-afe5-9c8c16c52f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d449edf19b4a4137834291ed12b803e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:23Z,use_quota=True,user_id='64f23cbf13e04e4bbca159635650608a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923303bb-0ac8-4794-85a3-fabb4ce5b1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923303bb-0ac8-4794-85a3-fabb4ce5b1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c4dfeb-9d22-4bf8-b6db-b9d4e1aa5d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:23 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:23:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c4dfeb-9d22-4bf8-b6db-b9d4e1aa5d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2974793-9af9-4490-afe5-9c8c16c52f97', 'volume_name': 'volume-a2974793-9af9-4490-afe5-9c8c16c52f97', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f39aa50>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca887de-cf40-4ade-9abe-13f77120998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca887de-cf40-4ade-9abe-13f77120998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c880a610-7b24-4de3-984f-b96b7ffa6080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Volume a2974793-9af9-4490-afe5-9c8c16c52f97: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2974793-9af9-4490-afe5-9c8c16c52f97', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f39aa50>}
Jul 23 03:23:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Trying to clone a2974793-9af9-4490-afe5-9c8c16c52f97 from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:23:25 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Image download 20.69 MB at 20.69 MB/s
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404f4c0-34ff-41a3-9eeb-39cbdae373da]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:25 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD
Jul 23 03:23:25 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:25 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d is fetched for user 64f23cbf13e04e4bbca159635650608a. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=145,cinder:UPDATE=168,cinder:DELETE=12,cinder:INSERT=39 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab87d4b-03c8-45d4-ab68-b0b701aab3f5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:25 devstack sudo[97952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD
Jul 23 03:23:25 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Flow 'volume_create_manager' (64353a93-1283-4961-8257-835f608815c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af509d42-5ca8-485b-80af-91ca0f81fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af509d42-5ca8-485b-80af-91ca0f81fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2132336670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c1fba0-d702-49bb-8ab8-900833044c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f715b32c9efe4407a0454fddc6f38b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:26Z,use_quota=True,user_id='87ed990918ff4ba4b01c0e3d577f10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b8a6b6-45ac-4dcc-ae0c-4ec45460a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b8a6b6-45ac-4dcc-ae0c-4ec45460a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7733698e-dada-46c6-8595-ae61c2dec591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7733698e-dada-46c6-8595-ae61c2dec591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c1fba0-d702-49bb-8ab8-900833044c8a', 'volume_name': 'volume-16c1fba0-d702-49bb-8ab8-900833044c8a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4095422-5ab0-49f0-bc70-46eab952c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4095422-5ab0-49f0-bc70-46eab952c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af625ebd-9da2-4c4e-b8a7-0960b9f6a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Volume 16c1fba0-d702-49bb-8ab8-900833044c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c1fba0-d702-49bb-8ab8-900833044c8a', 'volume_size': 1}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2132336670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c1fba0-d702-49bb-8ab8-900833044c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f715b32c9efe4407a0454fddc6f38b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:26Z,use_quota=True,user_id='87ed990918ff4ba4b01c0e3d577f10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Creating volume 16c1fba0-d702-49bb-8ab8-900833044c8a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:25 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:26 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a 1073741824
Jul 23 03:23:26 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:26 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:26 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a 1073741824" returned: 0 in 0.664s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:26 devstack sudo[97962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a
Jul 23 03:23:26 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:26 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a" returned: 0 in 0.267s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2067949943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2974793-9af9-4490-afe5-9c8c16c52f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d449edf19b4a4137834291ed12b803e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:23Z,use_quota=True,user_id='64f23cbf13e04e4bbca159635650608a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Creating volume a2974793-9af9-4490-afe5-9c8c16c52f97 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:26 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af625ebd-9da2-4c4e-b8a7-0960b9f6a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c1fba0-d702-49bb-8ab8-900833044c8a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e01d6d-08a8-421e-b715-4c2034bfeb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:27 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 1073741824
Jul 23 03:23:27 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Volume volume-16c1fba0-d702-49bb-8ab8-900833044c8a (16c1fba0-d702-49bb-8ab8-900833044c8a): created successfully
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e01d6d-08a8-421e-b715-4c2034bfeb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Flow 'volume_create_manager' (64353a93-1283-4961-8257-835f608815c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9bf81c39-da88-405d-9820-878393d7e0d6 tempest-VolumesTransfersV357Test-1084801908 None] Created volume successfully.
Jul 23 03:23:27 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 1073741824" returned: 0 in 0.562s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:27 devstack sudo[97971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97
Jul 23 03:23:27 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:27 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97" returned: 0 in 0.273s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Attempting download of d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume a2974793-9af9-4490-afe5-9c8c16c52f97. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c9228-280d-4c90-8a67-3156f9f0ac24]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:28 devstack sudo[97974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam
Jul 23 03:23:28 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:28 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam" returned: 0 in 0.420s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:28 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam
Jul 23 03:23:28 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:28 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam" returned: 1 in 0.428s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_sshw7fam' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:23:28 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e76f71d-b76f-4ebd-9959-a9ce5475255e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5d067ced-18ce-4b68-a836-f95757aacddb tempest-VolumesTransfersV357Test-838755507 None] Transfer volume completed successfully.
Jul 23 03:23:28 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD
Jul 23 03:23:28 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:29 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] d528e14a-f1e8-46f0-b9e4-aded7536eb2d was qcow2, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:29 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97
Jul 23 03:23:29 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Acquiring lock "cinder-16c1fba0-d702-49bb-8ab8-900833044c8a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-16c1fba0-d702-49bb-8ab8-900833044c8a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Acquiring lock "cinder-quobyte-16c1fba0-d702-49bb-8ab8-900833044c8a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-quobyte-16c1fba0-d702-49bb-8ab8-900833044c8a" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2950ff-e061-44d9-98d3-3ebddbf8c642]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:30 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a
Jul 23 03:23:30 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:30 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a" returned: 0 in 0.660s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:30 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a
Jul 23 03:23:30 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:30 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-16c1fba0-d702-49bb-8ab8-900833044c8a" returned: 0 in 0.390s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-quobyte-16c1fba0-d702-49bb-8ab8-900833044c8a" released by "delete_volume" :: held 1.115s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Created reservations ['1fa00d6c-b552-47a5-b162-66c93d9f10a6', '37906d32-8cce-4f5f-b0aa-1529bf3eed03', 'a8a43633-3970-441c-9d81-847fa39fdf6e', '25df5c1b-8a1b-41b3-8412-231301d5ca9b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:31 devstack sudo[98040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:31 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:31 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Deleted volume successfully.
Jul 23 03:23:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7c3db3c5-8563-44b3-b29b-b5ed41ef0509 tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-16c1fba0-d702-49bb-8ab8-900833044c8a-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:32 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97" returned: 0 in 2.728s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_fc2e2i41devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:23:32 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Converted 112.00 MB image at 41.03 MB/s
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:32 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 1G
Jul 23 03:23:32 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:32 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 1G" returned: 0 in 0.438s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Downloaded image d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume a2974793-9af9-4490-afe5-9c8c16c52f97 successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d for user 64f23cbf13e04e4bbca159635650608a is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Marking volume a2974793-9af9-4490-afe5-9c8c16c52f97 as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Copying metadata from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d to a2974793-9af9-4490-afe5-9c8c16c52f97. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Creating volume glance metadata for volume a2974793-9af9-4490-afe5-9c8c16c52f97 backed by image d528e14a-f1e8-46f0-b9e4-aded7536eb2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c880a610-7b24-4de3-984f-b96b7ffa6080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2974793-9af9-4490-afe5-9c8c16c52f97', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f39aa50>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e31bf78-309c-4ca3-bbd2-b1fbb09a7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:32 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Volume volume-a2974793-9af9-4490-afe5-9c8c16c52f97 (a2974793-9af9-4490-afe5-9c8c16c52f97): created successfully
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e31bf78-309c-4ca3-bbd2-b1fbb09a7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Flow 'volume_create_manager' (923a8783-f6c2-4d1a-8df8-20eefb5d3d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fd6ae824-9b46-4714-8558-0fb6d1138d70 tempest-VolumesImageMetadata-399553533 None] Created volume successfully.
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Flow 'volume_create_manager' (2d38364c-c41d-47d5-9b76-da162c9dcd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfafda8-4b80-40e6-91bf-1558d9073608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfafda8-4b80-40e6-91bf-1558d9073608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1537840964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490bbff7-ac2a-4bc7-8882-5da2ca7ede6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f715b32c9efe4407a0454fddc6f38b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='87ed990918ff4ba4b01c0e3d577f10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e76e799-598a-453c-9838-5db90dcdcbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e76e799-598a-453c-9838-5db90dcdcbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e5057-6642-4602-bb80-a19f658066bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e5057-6642-4602-bb80-a19f658066bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '490bbff7-ac2a-4bc7-8882-5da2ca7ede6f', 'volume_name': 'volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dec45e7-458c-4f53-bf68-34c23b6b9510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dec45e7-458c-4f53-bf68-34c23b6b9510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da09354c-c3f5-493e-9fd6-16cc3cc5f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:32 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Volume 490bbff7-ac2a-4bc7-8882-5da2ca7ede6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f', 'volume_size': 1}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1537840964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490bbff7-ac2a-4bc7-8882-5da2ca7ede6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f715b32c9efe4407a0454fddc6f38b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='87ed990918ff4ba4b01c0e3d577f10f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Creating volume 490bbff7-ac2a-4bc7-8882-5da2ca7ede6f {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:32 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:32 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f 1073741824
Jul 23 03:23:32 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Acquiring lock "cinder-a2974793-9af9-4490-afe5-9c8c16c52f97-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Lock "cinder-a2974793-9af9-4490-afe5-9c8c16c52f97-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Acquiring lock "cinder-quobyte-a2974793-9af9-4490-afe5-9c8c16c52f97" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Lock "cinder-quobyte-a2974793-9af9-4490-afe5-9c8c16c52f97" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b4bb3-cc4d-4ed2-b024-16b72440bcc5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:33 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f 1073741824" returned: 0 in 0.668s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:33 devstack sudo[98056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f
Jul 23 03:23:33 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:33 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97
Jul 23 03:23:33 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:33 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f" returned: 0 in 0.347s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da09354c-c3f5-493e-9fd6-16cc3cc5f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a768465-c678-45fb-8a87-72ff0a60d687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:34 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Volume volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f (490bbff7-ac2a-4bc7-8882-5da2ca7ede6f): created successfully
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a768465-c678-45fb-8a87-72ff0a60d687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Flow 'volume_create_manager' (2d38364c-c41d-47d5-9b76-da162c9dcd9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-09122edb-f1e6-4635-a510-deb29f544686 tempest-VolumesTransfersV357Test-1084801908 None] Created volume successfully.
Jul 23 03:23:34 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97" returned: 0 in 0.515s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:34 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97
Jul 23 03:23:34 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:34 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a2974793-9af9-4490-afe5-9c8c16c52f97" returned: 0 in 0.319s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Lock "cinder-quobyte-a2974793-9af9-4490-afe5-9c8c16c52f97" released by "delete_volume" :: held 0.894s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Created reservations ['75d56eab-b7b7-499b-969b-f50e1b15b1e0', '8db982a5-b9ba-4c8f-bd89-4f3c84bd1699', 'c8f4252b-a81d-49c4-b5cf-71263eedbc38', 'a01cf9e3-bb6c-44aa-8351-f76cbdc0f290'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:34 devstack sudo[98068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:34 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:34 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:34 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Deleted volume successfully.
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7b27a860-c4f9-404d-be28-71ac4868187f tempest-VolumesImageMetadata-399553533 None] Lock "cinder-a2974793-9af9-4490-afe5-9c8c16c52f97-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Acquiring lock "cinder-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Acquiring lock "cinder-quobyte-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-quobyte-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ae816-0af7-4deb-a851-cfc25104fdc2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:35 devstack sudo[98072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f
Jul 23 03:23:35 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:35 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f" returned: 0 in 0.514s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:36 devstack sudo[98077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f
Jul 23 03:23:36 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:36 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f" returned: 0 in 0.322s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-quobyte-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f" released by "delete_volume" :: held 0.893s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Created reservations ['e48c82d1-059d-4199-aa0b-4f55b5db7954', 'b8524071-9a1c-4684-84e6-7d0d9afd9f35', '868f29ba-f4f8-4bb7-a698-b38d68b44593', 'a619484a-9ec9-47ff-9cfe-8507f9f262a9'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:36 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:36 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:36 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.383s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:36 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Deleted volume successfully.
Jul 23 03:23:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a5595e95-2722-4a5c-a387-8f448e98e1df tempest-VolumesTransfersV357Test-799174132 None] Lock "cinder-490bbff7-ac2a-4bc7-8882-5da2ca7ede6f-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:37 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Flow 'volume_create_manager' (fa369d8b-8ebf-4d11-8ffe-86b8302748c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a89ad31-4a7a-46d7-94f4-9c6bdbb2f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a89ad31-4a7a-46d7-94f4-9c6bdbb2f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-888264559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e8d7e1-3235-445b-8686-94b0cc4b0208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6bdaca61124042aac58d3ada5f4c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:38Z,use_quota=True,user_id='0044b16faa08428ea13c8cb3a0fc5e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4f8a66-19ed-44f0-92a1-da919cece939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4f8a66-19ed-44f0-92a1-da919cece939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31892af-e822-4186-abaf-f8312d439de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31892af-e822-4186-abaf-f8312d439de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e8d7e1-3235-445b-8686-94b0cc4b0208', 'volume_name': 'volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0420322-9d3a-409f-8cdb-81d5775e6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0420322-9d3a-409f-8cdb-81d5775e6422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ffd7f6-c566-41ba-8e5b-37cb17d25916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Volume c4e8d7e1-3235-445b-8686-94b0cc4b0208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208', 'volume_size': 1}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-888264559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e8d7e1-3235-445b-8686-94b0cc4b0208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6bdaca61124042aac58d3ada5f4c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:38Z,use_quota=True,user_id='0044b16faa08428ea13c8cb3a0fc5e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Creating volume c4e8d7e1-3235-445b-8686-94b0cc4b0208 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:38 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:38 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 1073741824
Jul 23 03:23:38 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:38 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 1073741824" returned: 0 in 0.682s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:38 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208
Jul 23 03:23:38 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:39 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208" returned: 0 in 0.532s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ffd7f6-c566-41ba-8e5b-37cb17d25916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3288450-47f4-4706-b58c-6057577dbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Volume volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 (c4e8d7e1-3235-445b-8686-94b0cc4b0208): created successfully
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3288450-47f4-4706-b58c-6057577dbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Flow 'volume_create_manager' (fa369d8b-8ebf-4d11-8ffe-86b8302748c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f9b746cc-b17e-4535-8bb6-e37ba945dced tempest-AbsoluteLimitsTests-82271566 None] Created volume successfully.
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Flow 'volume_create_manager' (e1586890-41e1-44c8-bb39-dbf5690d4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7cee57-853d-4fc7-b89e-abf55d1e334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7cee57-853d-4fc7-b89e-abf55d1e334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2059586436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08af0cc2-0f19-4066-8280-dd94db3cd5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abf03b7315a4224bb6e38a2241f8974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:40Z,use_quota=True,user_id='d871123883c541deb72572096d66a914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d782d852-9d50-4c19-92c3-fed6663147c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d782d852-9d50-4c19-92c3-fed6663147c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c2565-de38-4ded-a254-d9f01e917306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c2565-de38-4ded-a254-d9f01e917306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'volume_name': 'volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d10bcc8-684c-4e9b-a975-31e3c97d962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d10bcc8-684c-4e9b-a975-31e3c97d962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e780fd-c7fd-4794-aa2e-c9b47f878814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Volume 08af0cc2-0f19-4066-8280-dd94db3cd5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'volume_size': 1}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2059586436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08af0cc2-0f19-4066-8280-dd94db3cd5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abf03b7315a4224bb6e38a2241f8974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:40Z,use_quota=True,user_id='d871123883c541deb72572096d66a914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Creating volume 08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:40 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:40 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd 1073741824
Jul 23 03:23:40 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Acquiring lock "cinder-c4e8d7e1-3235-445b-8686-94b0cc4b0208-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Lock "cinder-c4e8d7e1-3235-445b-8686-94b0cc4b0208-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Acquiring lock "cinder-quobyte-c4e8d7e1-3235-445b-8686-94b0cc4b0208" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Lock "cinder-quobyte-c4e8d7e1-3235-445b-8686-94b0cc4b0208" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e9194e-66dc-4fa4-893a-78c46c330009]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:40 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208
Jul 23 03:23:40 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:41 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd 1073741824" returned: 0 in 0.709s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:41 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208" returned: 0 in 0.497s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:41 devstack sudo[98103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:23:41 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:41 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208
Jul 23 03:23:41 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:41 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.371s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e780fd-c7fd-4794-aa2e-c9b47f878814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800a92fe-1da7-484c-876a-cccf1278d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:41 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4e8d7e1-3235-445b-8686-94b0cc4b0208" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Volume volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd (08af0cc2-0f19-4066-8280-dd94db3cd5cd): created successfully
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800a92fe-1da7-484c-876a-cccf1278d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Flow 'volume_create_manager' (e1586890-41e1-44c8-bb39-dbf5690d4de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Lock "cinder-quobyte-c4e8d7e1-3235-445b-8686-94b0cc4b0208" released by "delete_volume" :: held 0.965s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-00a4f85d-d142-4157-ac9f-89845eb20cb4 tempest-VolumesCloneTest-1122024767 None] Created volume successfully.
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Created reservations ['a150cd28-49d9-4b0e-a41f-5bb58d0bf69e', '1d2c7fa5-3f7b-4933-bb5d-443466cc8397', '117650f7-ca95-4ff0-89ea-63270acb3daf', '5c1cf254-1140-48eb-90b4-d5dd16471ce0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:41 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:41 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:42 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.301s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:42 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Deleted volume successfully.
Jul 23 03:23:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0ab436d4-cbd4-429b-879a-bd4d5ca90245 tempest-AbsoluteLimitsTests-82271566 None] Lock "cinder-c4e8d7e1-3235-445b-8686-94b0cc4b0208-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Flow 'volume_create_manager' (c560c8ca-942e-4cf3-9ff6-b9c9d421b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af13064-befa-4938-9915-511f5a7c57b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af13064-befa-4938-9915-511f5a7c57b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1459789186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec1be6-eed3-4c32-b4da-1d398bcdbcae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abf03b7315a4224bb6e38a2241f8974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=08af0cc2-0f19-4066-8280-dd94db3cd5cd,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:43Z,use_quota=True,user_id='d871123883c541deb72572096d66a914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16620100-2e08-4546-8afe-a08fbb740cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16620100-2e08-4546-8afe-a08fbb740cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7833fe98-52ca-4f98-a3eb-74c891611373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7833fe98-52ca-4f98-a3eb-74c891611373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd8ec1be6-eed3-4c32-b4da-1d398bcdbcae', 'volume_name': 'volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae', 'volume_size': 2, 'source_volid': '08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'source_volstatus': 'available'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4989d4d-84e9-425a-b0b1-c54ceeab9e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4989d4d-84e9-425a-b0b1-c54ceeab9e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a990f5af-9d75-47d3-b4ce-508835a6328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Volume d8ec1be6-eed3-4c32-b4da-1d398bcdbcae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae', 'volume_size': 2, 'source_volid': '08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'source_volstatus': 'available'}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:43 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Cloning volume 08af0cc2-0f19-4066-8280-dd94db3cd5cd to volume d8ec1be6-eed3-4c32-b4da-1d398bcdbcae
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Creating offline snapshot 33fe18c6-129c-4b1a-8c57-e30035585fb1 of volume 08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e5c56-cbc1-4680-94fb-e49ea6875868]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:43 devstack sudo[98112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:23:43 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:43 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.560s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:44 devstack sudo[98117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 1G
Jul 23 03:23:44 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:44 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 1G" returned: 0 in 0.715s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:44 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1
Jul 23 03:23:44 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:45 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1" returned: 0 in 0.499s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:45 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 is being set with open permissions: ugo+rw
Jul 23 03:23:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:45 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1
Jul 23 03:23:45 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:45 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1" returned: 0 in 0.351s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:45 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info
Jul 23 03:23:45 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:45 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info" returned: 0 in 0.359s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:45 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info is being set with open permissions: ugo+rw
Jul 23 03:23:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:45 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info
Jul 23 03:23:45 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:46 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.info" returned: 0 in 0.351s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "cinder-quobyte-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] snapshot: 33fe18c6-129c-4b1a-8c57-e30035585fb1, volume: d8ec1be6-eed3-4c32-b4da-1d398bcdbcae,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937aa0c-3462-4311-83a2-bce143b181aa]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:46 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1
Jul 23 03:23:46 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1" returned: 0 in 0.586s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:23:47 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[27211a1f-b782-4dea-860e-5f8f8a5ade86]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:47 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:23:47 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:47 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.461s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:23:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:47 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae
Jul 23 03:23:47 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:51 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Flow 'volume_create_manager' (1af414fb-e218-4dbb-9d5a-0d0f23feb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18734a9a-c09f-4010-bcdf-f8e32adf7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18734a9a-c09f-4010-bcdf-f8e32adf7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1757682810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759c049e-6975-4d36-8788-d842a43a2f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a778ac733240d6bbfdda2ae6296c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:52Z,use_quota=True,user_id='82438c02277e4de1866ae9d15fde355e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48a654d-1f1a-4d1a-ac30-3585af2d62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48a654d-1f1a-4d1a-ac30-3585af2d62de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde10958-a313-4cbc-8a70-549f2f24789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde10958-a313-4cbc-8a70-549f2f24789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759c049e-6975-4d36-8788-d842a43a2f21', 'volume_name': 'volume-759c049e-6975-4d36-8788-d842a43a2f21', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334c1aa9-72b2-428b-869e-c24a269f41e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334c1aa9-72b2-428b-869e-c24a269f41e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d06896-fe1b-40f3-9447-ec666867ba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:52 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Volume 759c049e-6975-4d36-8788-d842a43a2f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759c049e-6975-4d36-8788-d842a43a2f21', 'volume_size': 1}
Jul 23 03:23:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:53 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" returned: 0 in 6.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c53d433-a5ea-4a53-8f01-1135e3e0f222]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:54 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:23:54 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:54 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.646s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:23:54 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Converted 1024.00 MB image at 159.86 MB/s
Jul 23 03:23:54 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae is being set with open permissions: ugo+rw
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:54 devstack sudo[98192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae
Jul 23 03:23:54 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:54 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" released by "_copy_volume_from_snapshot" :: held 8.549s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "cinder-quobyte-33fe18c6-129c-4b1a-8c57-e30035585fb1" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-33fe18c6-129c-4b1a-8c57-e30035585fb1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Deleting offline snapshot 33fe18c6-129c-4b1a-8c57-e30035585fb1 of volume 08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:23:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] snapshot_file for this snap is: volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:23:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ea783-c2b6-4794-8bff-91561d28735e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:55 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1
Jul 23 03:23:55 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:55 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:23:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe90f7e-de6b-440b-a64f-740a53852c98]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:55 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:23:55 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:56 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.674s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:56 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1
Jul 23 03:23:56 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:56 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1" returned: 0 in 0.705s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:56 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1
Jul 23 03:23:56 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:57 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd.33fe18c6-129c-4b1a-8c57-e30035585fb1" returned: 0 in 0.290s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-33fe18c6-129c-4b1a-8c57-e30035585fb1" released by "_delete_snapshot" :: held 2.290s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.086s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1757682810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759c049e-6975-4d36-8788-d842a43a2f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a778ac733240d6bbfdda2ae6296c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:52Z,use_quota=True,user_id='82438c02277e4de1866ae9d15fde355e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Creating volume 759c049e-6975-4d36-8788-d842a43a2f21 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:23:57 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:57 devstack sudo[98296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21 1073741824
Jul 23 03:23:57 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a990f5af-9d75-47d3-b4ce-508835a6328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae', 'volume_size': 2, 'source_volid': '08af0cc2-0f19-4066-8280-dd94db3cd5cd', 'source_volstatus': 'available'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fc2724-9e60-4d17-967e-f6bbf22be608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:57 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Volume volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae (d8ec1be6-eed3-4c32-b4da-1d398bcdbcae): created successfully
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fc2724-9e60-4d17-967e-f6bbf22be608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Flow 'volume_create_manager' (c560c8ca-942e-4cf3-9ff6-b9c9d421b587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b29d8dab-cc74-4693-ac6d-23e2b9fda328 tempest-VolumesCloneTest-1122024767 None] Created volume successfully.
Jul 23 03:23:57 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21 1073741824" returned: 0 in 0.621s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:58 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21
Jul 23 03:23:58 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "cinder-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "cinder-quobyte-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de70a6d-7d43-4a3a-9644-ed26144783e2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:58 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d06896-fe1b-40f3-9447-ec666867ba9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759c049e-6975-4d36-8788-d842a43a2f21', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfc8520-f7db-4182-942c-38cdf3b08a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:23:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Volume volume-759c049e-6975-4d36-8788-d842a43a2f21 (759c049e-6975-4d36-8788-d842a43a2f21): created successfully
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfc8520-f7db-4182-942c-38cdf3b08a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Flow 'volume_create_manager' (1af414fb-e218-4dbb-9d5a-0d0f23feb824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:23:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-73eef71a-ab2c-4eba-abd6-b40a57315f1e tempest-VolumesMetadataTest-421249916 None] Created volume successfully.
Jul 23 03:23:58 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae
Jul 23 03:23:58 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:58 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:58 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:59 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" returned: 0 in 0.785s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:59 devstack sudo[98314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae
Jul 23 03:23:59 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:23:59 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.568s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:23:59 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" returned: 0 in 0.489s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae" released by "delete_volume" :: held 1.356s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Created reservations ['8f30866b-c021-48b6-b17f-d12f304a8ce4', 'b256c6db-4ca9-474a-b098-c3c226e2a191', '941fcf3d-bd70-4594-8f2d-cecd26d01c4f', '310f95b2-519b-44aa-9fce-5f494f7c5e4d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:23:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:23:59 devstack sudo[98318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:23:59 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:00 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.596s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Deleted volume successfully.
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-af41b9ca-a6a5-4d64-a937-28f7c5f5aea7 tempest-VolumesCloneTest-1122024767 None] Lock "cinder-d8ec1be6-eed3-4c32-b4da-1d398bcdbcae-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Acquiring lock "cinder-08af0cc2-0f19-4066-8280-dd94db3cd5cd-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Lock "cinder-08af0cc2-0f19-4066-8280-dd94db3cd5cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Acquiring lock "cinder-quobyte-08af0cc2-0f19-4066-8280-dd94db3cd5cd" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-08af0cc2-0f19-4066-8280-dd94db3cd5cd" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1a6d8-f1ec-4c75-af8b-cd2601232829]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Acquiring lock "cinder-759c049e-6975-4d36-8788-d842a43a2f21-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:01 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Lock "cinder-759c049e-6975-4d36-8788-d842a43a2f21-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:01 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (0f6799b9-3898-457c-9476-e6142e04f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c601e3b0-ec0f-4c94-9f03-06088fbfacd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c601e3b0-ec0f-4c94-9f03-06088fbfacd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1130337752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49da886b-a19e-4cb8-95ee-755a3d9b6063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:01Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3250558a-b8d3-4f71-800f-f4a25b6f4847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3250558a-b8d3-4f71-800f-f4a25b6f4847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f92d28-1efa-4b82-b33a-2b73f48f1479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f92d28-1efa-4b82-b33a-2b73f48f1479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49da886b-a19e-4cb8-95ee-755a3d9b6063', 'volume_name': 'volume-49da886b-a19e-4cb8-95ee-755a3d9b6063', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf23c4f-ba7b-47e5-8519-02a545baee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf23c4f-ba7b-47e5-8519-02a545baee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adad920-742f-4b72-a2e7-e24be69c7ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Volume 49da886b-a19e-4cb8-95ee-755a3d9b6063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49da886b-a19e-4cb8-95ee-755a3d9b6063', 'volume_size': 1}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1130337752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49da886b-a19e-4cb8-95ee-755a3d9b6063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:01Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Creating volume 49da886b-a19e-4cb8-95ee-755a3d9b6063 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:01 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Acquiring lock "cinder-quobyte-759c049e-6975-4d36-8788-d842a43a2f21" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:01 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 1073741824
Jul 23 03:24:01 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Lock "cinder-quobyte-759c049e-6975-4d36-8788-d842a43a2f21" acquired by "delete_volume" :: waited 0.040s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633e2ec-ac90-45be-9516-5ee116ffda50]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:01 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21
Jul 23 03:24:01 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:01 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.824s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:01 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd
Jul 23 03:24:01 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:02 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 1073741824" returned: 0 in 0.859s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:02 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21" returned: 0 in 0.744s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:02 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-08af0cc2-0f19-4066-8280-dd94db3cd5cd" returned: 0 in 0.546s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:02 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21
Jul 23 03:24:02 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Lock "cinder-quobyte-08af0cc2-0f19-4066-8280-dd94db3cd5cd" released by "delete_volume" :: held 1.480s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:02 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063
Jul 23 03:24:02 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Created reservations ['5e6546a4-9fc7-437f-8f74-1229b323b231', 'a3008e02-d4d2-4365-ac35-7884eacfc47d', '93d901ea-aa72-4692-960d-0d1c2d352480', '39412ebc-edab-4e88-a0be-43075fbf28be'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:02 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:02 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:02 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-759c049e-6975-4d36-8788-d842a43a2f21" returned: 0 in 0.560s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Lock "cinder-quobyte-759c049e-6975-4d36-8788-d842a43a2f21" released by "delete_volume" :: held 1.401s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:03 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063" returned: 0 in 0.578s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Created reservations ['22c8ed77-bfa4-42e8-90f7-d3a8dbffd80e', '93499209-8411-4125-8c3c-128b24b0b03c', '20a64676-9b3e-4cf6-9531-212cfe1732e6', 'b267e7c5-d095-4ada-8a50-cecdf0e034b2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adad920-742f-4b72-a2e7-e24be69c7ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49da886b-a19e-4cb8-95ee-755a3d9b6063', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db18c0e0-5cd1-4b4f-81d7-1157e1fc4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:03 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Volume volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 (49da886b-a19e-4cb8-95ee-755a3d9b6063): created successfully
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db18c0e0-5cd1-4b4f-81d7-1157e1fc4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (0f6799b9-3898-457c-9476-e6142e04f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:03 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.395s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Deleted volume successfully.
Jul 23 03:24:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-48234b8c-6aea-45ea-b16d-a41025d33656 tempest-VolumesActionsTest-1589305460 None] Created volume successfully.
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-00e8c448-c355-4833-a8e9-a2f55cf15d1b tempest-VolumesCloneTest-1122024767 None] Lock "cinder-08af0cc2-0f19-4066-8280-dd94db3cd5cd-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:03 devstack sudo[98351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:03 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53022c09-d416-4bc4-8b85-9feb0d96d0d4 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063" by "attach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53022c09-d416-4bc4-8b85-9feb0d96d0d4 tempest-VolumesActionsTest-1589305460 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063" acquired by "attach_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-53022c09-d416-4bc4-8b85-9feb0d96d0d4 tempest-VolumesActionsTest-1589305460 None] Attaching volume 49da886b-a19e-4cb8-95ee-755a3d9b6063 to instance cd37d2fe-61e7-4590-aed6-34721f043959 at mountpoint /dev/vdb on host None.
Jul 23 03:24:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-53022c09-d416-4bc4-8b85-9feb0d96d0d4 tempest-VolumesActionsTest-1589305460 None] Attach volume completed successfully.
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53022c09-d416-4bc4-8b85-9feb0d96d0d4 tempest-VolumesActionsTest-1589305460 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063" released by "attach_volume" :: held 0.169s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:03 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.498s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Deleted volume successfully.
Jul 23 03:24:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fadf9203-91d2-4c2e-a81c-4315355d405b tempest-VolumesMetadataTest-421249916 None] Lock "cinder-759c049e-6975-4d36-8788-d842a43a2f21-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-378486cb-625a-4c4a-b3b7-95229fbea7f1 tempest-VolumesActionsTest-837083907 None] Terminate volume connection completed successfully.
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-378486cb-625a-4c4a-b3b7-95229fbea7f1 tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-detach_volume" by "detach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-378486cb-625a-4c4a-b3b7-95229fbea7f1 tempest-VolumesActionsTest-837083907 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-378486cb-625a-4c4a-b3b7-95229fbea7f1 tempest-VolumesActionsTest-837083907 None] Detaching volume 49da886b-a19e-4cb8-95ee-755a3d9b6063 from instance cd37d2fe-61e7-4590-aed6-34721f043959.
Jul 23 03:24:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-378486cb-625a-4c4a-b3b7-95229fbea7f1 tempest-VolumesActionsTest-837083907 None] Detach volume completed successfully.
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-378486cb-625a-4c4a-b3b7-95229fbea7f1 tempest-VolumesActionsTest-837083907 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37f36fee-df6e-48d0-a47f-0bb0db08e289 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-detach_volume" by "detach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37f36fee-df6e-48d0-a47f-0bb0db08e289 tempest-VolumesActionsTest-1589305460 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-37f36fee-df6e-48d0-a47f-0bb0db08e289 tempest-VolumesActionsTest-1589305460 None] Volume detach called, but volume not attached.
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-37f36fee-df6e-48d0-a47f-0bb0db08e289 tempest-VolumesActionsTest-1589305460 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Acquiring lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Acquiring lock "cinder-quobyte-49da886b-a19e-4cb8-95ee-755a3d9b6063" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Lock "cinder-quobyte-49da886b-a19e-4cb8-95ee-755a3d9b6063" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[932faa93-dd35-411d-9eb2-c5054d31d59f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:06 devstack sudo[98357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063
Jul 23 03:24:06 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:06 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063" returned: 0 in 0.525s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:06 devstack sudo[98363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063
Jul 23 03:24:06 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:07 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-49da886b-a19e-4cb8-95ee-755a3d9b6063" returned: 0 in 0.515s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Lock "cinder-quobyte-49da886b-a19e-4cb8-95ee-755a3d9b6063" released by "delete_volume" :: held 1.107s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Created reservations ['2546ba0c-b8dc-4812-b754-029d20e3435f', '62f97d6f-7f11-41e5-b184-0a1ecd96931e', 'fa2bae88-9780-45fc-8de2-ac97273ae74d', '390754df-833e-4a27-b31e-ebc1c027f917'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:07 devstack sudo[98366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:07 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:07 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.472s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Deleted volume successfully.
Jul 23 03:24:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f93054ac-9101-4809-8ff0-bd011b88243e tempest-VolumesActionsTest-1589305460 None] Lock "cinder-49da886b-a19e-4cb8-95ee-755a3d9b6063-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Flow 'volume_create_manager' (3181316d-1cbe-4b08-87fa-a8b9a2246ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90cecee-4b44-4b46-a51e-d0cf677b388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90cecee-4b44-4b46-a51e-d0cf677b388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-335082800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9407670f-f25c-4b15-9079-7519abbfdc76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2e5b4c851a54727b68071a0c2fa0488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:10Z,use_quota=True,user_id='ebc0b270b5bb48239d3a6dfc3f05ef1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64689033-1822-4e7e-8536-1f7e7fc9b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64689033-1822-4e7e-8536-1f7e7fc9b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621a676f-82a1-4bb0-a0bf-b9f0cca47f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621a676f-82a1-4bb0-a0bf-b9f0cca47f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9407670f-f25c-4b15-9079-7519abbfdc76', 'volume_name': 'volume-9407670f-f25c-4b15-9079-7519abbfdc76', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a49809-6c1b-4096-8c74-ea46f58dabcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a49809-6c1b-4096-8c74-ea46f58dabcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0008f388-2517-4f46-881a-f2ebfb5dad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Volume 9407670f-f25c-4b15-9079-7519abbfdc76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9407670f-f25c-4b15-9079-7519abbfdc76', 'volume_size': 1}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-335082800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9407670f-f25c-4b15-9079-7519abbfdc76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2e5b4c851a54727b68071a0c2fa0488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:10Z,use_quota=True,user_id='ebc0b270b5bb48239d3a6dfc3f05ef1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Creating volume 9407670f-f25c-4b15-9079-7519abbfdc76 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:10 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:10 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76 1073741824
Jul 23 03:24:10 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Flow 'volume_create_manager' (547d8cf7-d3c4-49ec-ab42-ac3f50c4ec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24bd76d-26fd-4caf-b8d9-a976cc3af3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24bd76d-26fd-4caf-b8d9-a976cc3af3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005872722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2af8c7-8460-442d-977a-919f31697017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a028d2f127364cec9e17ec3fa6884772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:10Z,use_quota=True,user_id='7678c3d910e549d3b066e0c74dfef20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cccff9-75f5-4eb7-854e-c43ec45b9295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cccff9-75f5-4eb7-854e-c43ec45b9295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f95987f-8b97-4464-9c81-57e966ef54e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f95987f-8b97-4464-9c81-57e966ef54e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2af8c7-8460-442d-977a-919f31697017', 'volume_name': 'volume-eb2af8c7-8460-442d-977a-919f31697017', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5a3b7-6600-48e7-ab5d-6e9569eed6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5a3b7-6600-48e7-ab5d-6e9569eed6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7286cd56-6a6c-423f-b82b-1b98d0909149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:10 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Volume eb2af8c7-8460-442d-977a-919f31697017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2af8c7-8460-442d-977a-919f31697017', 'volume_size': 1}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:10 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76 1073741824" returned: 0 in 0.593s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:10 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76
Jul 23 03:24:10 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:11 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005872722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2af8c7-8460-442d-977a-919f31697017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a028d2f127364cec9e17ec3fa6884772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:10Z,use_quota=True,user_id='7678c3d910e549d3b066e0c74dfef20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Creating volume eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:11 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0008f388-2517-4f46-881a-f2ebfb5dad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9407670f-f25c-4b15-9079-7519abbfdc76', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:11 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 1073741824
Jul 23 03:24:11 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b6b4a5-1bd2-48a9-900b-2feb50580174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Volume volume-9407670f-f25c-4b15-9079-7519abbfdc76 (9407670f-f25c-4b15-9079-7519abbfdc76): created successfully
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b6b4a5-1bd2-48a9-900b-2feb50580174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Flow 'volume_create_manager' (3181316d-1cbe-4b08-87fa-a8b9a2246ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c626da8a-54e1-4e49-82cc-990173f26c0c tempest-VolumesListTestJSON-1751099449 None] Created volume successfully.
Jul 23 03:24:11 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=116,cinder:DELETE=10 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 1073741824" returned: 0 in 0.548s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (5367fac6-7196-461b-8dcf-dbae4f086553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bb8182-901d-4c01-bd64-8181a97474d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bb8182-901d-4c01-bd64-8181a97474d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1542848247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b58254-b46e-4827-8283-7365b75a8d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:12Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f452720-30e2-49bb-b72e-236f51a5e1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f452720-30e2-49bb-b72e-236f51a5e1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4ae115-303a-4c5e-85ed-03ae9d4a60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4ae115-303a-4c5e-85ed-03ae9d4a60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b58254-b46e-4827-8283-7365b75a8d53', 'volume_name': 'volume-95b58254-b46e-4827-8283-7365b75a8d53', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2420973-dcde-4391-91d0-9e3298639657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2420973-dcde-4391-91d0-9e3298639657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e177280-bec6-4f11-8add-db19840d7594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Volume 95b58254-b46e-4827-8283-7365b75a8d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b58254-b46e-4827-8283-7365b75a8d53', 'volume_size': 1}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:11 devstack sudo[98414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:24:11 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Flow 'volume_create_manager' (fda40144-6f73-46a3-973e-2c4774d67b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f254456-a56c-45a7-8b32-2e820f473d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f254456-a56c-45a7-8b32-2e820f473d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1834389234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ac66a4-0be5-400b-a31e-6682927e5a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05007dd76a3a43c18a67b9531365b491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:12Z,use_quota=True,user_id='9e808771cd7e4d9c98575b065244f244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34451daf-ce6d-4c1d-9c4b-86b0c3b79b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34451daf-ce6d-4c1d-9c4b-86b0c3b79b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f578a81-2227-4e0e-9e13-bf24ce36c3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f578a81-2227-4e0e-9e13-bf24ce36c3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ac66a4-0be5-400b-a31e-6682927e5a39', 'volume_name': 'volume-13ac66a4-0be5-400b-a31e-6682927e5a39', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5aacc3-a12e-4922-93ec-47d80b3c25b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5aacc3-a12e-4922-93ec-47d80b3c25b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0602b6-a0d5-469e-aa1b-fec6115a6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Volume 13ac66a4-0be5-400b-a31e-6682927e5a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ac66a4-0be5-400b-a31e-6682927e5a39', 'volume_size': 1}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:12 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.261s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1542848247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b58254-b46e-4827-8283-7365b75a8d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:12Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Creating volume 95b58254-b46e-4827-8283-7365b75a8d53 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7286cd56-6a6c-423f-b82b-1b98d0909149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2af8c7-8460-442d-977a-919f31697017', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc142fd-c786-4dad-9b77-512a3e24c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack sudo[98417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53 1073741824
Jul 23 03:24:12 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Volume volume-eb2af8c7-8460-442d-977a-919f31697017 (eb2af8c7-8460-442d-977a-919f31697017): created successfully
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc142fd-c786-4dad-9b77-512a3e24c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Flow 'volume_create_manager' (547d8cf7-d3c4-49ec-ab42-ac3f50c4ec0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a5a36dfd-7c64-4243-ae7f-9333a39e54b4 tempest-VolumesActionsTest-1237777530 None] Created volume successfully.
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Flow 'volume_create_manager' (df8412dc-08fe-49fd-9b40-dfa92cc9417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c2fcd4-151e-459b-9701-bf5e1c7f08da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c2fcd4-151e-459b-9701-bf5e1c7f08da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1430962437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee7164d-d3ec-4b1a-a552-9edadf8ed54e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2e5b4c851a54727b68071a0c2fa0488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:12Z,use_quota=True,user_id='ebc0b270b5bb48239d3a6dfc3f05ef1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeda3916-b4ba-48a3-b8cd-f9118d81e944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeda3916-b4ba-48a3-b8cd-f9118d81e944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac01965-35f0-4dc2-b9fe-91e64c98a083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac01965-35f0-4dc2-b9fe-91e64c98a083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee7164d-d3ec-4b1a-a552-9edadf8ed54e', 'volume_name': 'volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837d6e65-82db-470b-b5bc-e45f20b57610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837d6e65-82db-470b-b5bc-e45f20b57610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b261dcdb-76d0-4d4a-95be-00101aa6a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Volume 3ee7164d-d3ec-4b1a-a552-9edadf8ed54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e', 'volume_size': 1}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:12 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53 1073741824" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:12 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53
Jul 23 03:24:12 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:12 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1834389234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ac66a4-0be5-400b-a31e-6682927e5a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05007dd76a3a43c18a67b9531365b491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:12Z,use_quota=True,user_id='9e808771cd7e4d9c98575b065244f244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Creating volume 13ac66a4-0be5-400b-a31e-6682927e5a39 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e177280-bec6-4f11-8add-db19840d7594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b58254-b46e-4827-8283-7365b75a8d53', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:12 devstack sudo[98426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39 1073741824
Jul 23 03:24:12 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289b51a7-db06-4433-9990-1e2a56f36213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Volume volume-95b58254-b46e-4827-8283-7365b75a8d53 (95b58254-b46e-4827-8283-7365b75a8d53): created successfully
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289b51a7-db06-4433-9990-1e2a56f36213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (5367fac6-7196-461b-8dcf-dbae4f086553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:13 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4f0045e4-f008-4d95-ac59-cbfe8cccccdd tempest-VolumesActionsTest-1589305460 None] Created volume successfully.
Jul 23 03:24:13 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39 1073741824" returned: 0 in 0.465s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:13 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39
Jul 23 03:24:13 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:13 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39" returned: 0 in 0.289s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1430962437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee7164d-d3ec-4b1a-a552-9edadf8ed54e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2e5b4c851a54727b68071a0c2fa0488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:12Z,use_quota=True,user_id='ebc0b270b5bb48239d3a6dfc3f05ef1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Creating volume 3ee7164d-d3ec-4b1a-a552-9edadf8ed54e {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:13 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0602b6-a0d5-469e-aa1b-fec6115a6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ac66a4-0be5-400b-a31e-6682927e5a39', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:13 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e 1073741824
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2691eb7-c434-430f-85cf-e28683c6b89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:13 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:13 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Volume volume-13ac66a4-0be5-400b-a31e-6682927e5a39 (13ac66a4-0be5-400b-a31e-6682927e5a39): created successfully
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2691eb7-c434-430f-85cf-e28683c6b89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Flow 'volume_create_manager' (fda40144-6f73-46a3-973e-2c4774d67b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:13 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-addd12fc-30b4-44d5-8d3d-65e8519f5f58 tempest-VolumesTransfersV355Test-1215721215 None] Created volume successfully.
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-95b58254-b46e-4827-8283-7365b75a8d53-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Lock "cinder-95b58254-b46e-4827-8283-7365b75a8d53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-quobyte-95b58254-b46e-4827-8283-7365b75a8d53" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-95b58254-b46e-4827-8283-7365b75a8d53" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee75432-64f7-46ea-a981-d0877598fdf4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:14 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53
Jul 23 03:24:14 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:14 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e 1073741824" returned: 0 in 0.626s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:14 devstack sudo[98446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e
Jul 23 03:24:14 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:14 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53" returned: 0 in 0.487s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:14 devstack sudo[98451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53
Jul 23 03:24:14 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:14 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e" returned: 0 in 0.372s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b261dcdb-76d0-4d4a-95be-00101aa6a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ab62f0-9919-45f3-a501-32494b2fba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:14 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Volume volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e (3ee7164d-d3ec-4b1a-a552-9edadf8ed54e): created successfully
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ab62f0-9919-45f3-a501-32494b2fba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Flow 'volume_create_manager' (df8412dc-08fe-49fd-9b40-dfa92cc9417a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-805a60a4-e73b-4ebf-8fdc-a49063bc2e73 tempest-VolumesListTestJSON-1751099449 None] Created volume successfully.
Jul 23 03:24:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cae175b8-5485-489c-abce-82c692b6f981 tempest-VolumesTransfersV355Test-1224866469 None] Transfer volume completed successfully.
Jul 23 03:24:15 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-95b58254-b46e-4827-8283-7365b75a8d53" returned: 0 in 0.396s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-95b58254-b46e-4827-8283-7365b75a8d53" released by "delete_volume" :: held 0.933s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Created reservations ['c36badc5-0134-49b7-89ab-fd5557e28e18', '2dac9757-b318-46d9-9abb-7be11a2a9b08', '91bcabee-83b1-4731-bbcb-02f52ea3896f', '3894a5a2-8d4f-4dbe-a111-21bc4d084a86'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:15 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:15 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Acquiring lock "cinder-13ac66a4-0be5-400b-a31e-6682927e5a39-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-13ac66a4-0be5-400b-a31e-6682927e5a39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:15 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.404s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Deleted volume successfully.
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6888ad58-d6a5-46aa-aea8-45ec39f7545a tempest-VolumesActionsTest-837083907 None] Lock "cinder-95b58254-b46e-4827-8283-7365b75a8d53-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Acquiring lock "cinder-quobyte-13ac66a4-0be5-400b-a31e-6682927e5a39" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-quobyte-13ac66a4-0be5-400b-a31e-6682927e5a39" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7418ef75-eb7f-4090-b306-60c17f75c001]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:15 devstack sudo[98463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39
Jul 23 03:24:15 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:16 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39" returned: 0 in 0.515s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:16 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39
Jul 23 03:24:16 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:16 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Flow 'volume_create_manager' (c8dbe3aa-bb84-4af8-8a2a-b136ddfb31ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a933fc8-dfad-43f5-a0a9-f52bedfbeab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-13ac66a4-0be5-400b-a31e-6682927e5a39" returned: 0 in 0.424s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a933fc8-dfad-43f5-a0a9-f52bedfbeab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-828303185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31411887-824b-4434-bcdd-924549e860af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2e5b4c851a54727b68071a0c2fa0488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:17Z,use_quota=True,user_id='ebc0b270b5bb48239d3a6dfc3f05ef1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc535f2-e186-4443-935e-c46230803827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc535f2-e186-4443-935e-c46230803827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b97eee8-5fad-42ad-bbcb-8ab64b864016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b97eee8-5fad-42ad-bbcb-8ab64b864016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31411887-824b-4434-bcdd-924549e860af', 'volume_name': 'volume-31411887-824b-4434-bcdd-924549e860af', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29105cb5-0ea1-4031-8f21-4f3de640c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29105cb5-0ea1-4031-8f21-4f3de640c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b252b198-1747-4eb3-a2c3-9cb1ab520dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Volume 31411887-824b-4434-bcdd-924549e860af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31411887-824b-4434-bcdd-924549e860af', 'volume_size': 1}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-828303185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31411887-824b-4434-bcdd-924549e860af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b2e5b4c851a54727b68071a0c2fa0488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:17Z,use_quota=True,user_id='ebc0b270b5bb48239d3a6dfc3f05ef1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Creating volume 31411887-824b-4434-bcdd-924549e860af {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:16 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-quobyte-13ac66a4-0be5-400b-a31e-6682927e5a39" released by "delete_volume" :: held 1.065s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:16 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af 1073741824
Jul 23 03:24:16 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:16 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Created reservations ['f507f3b7-2a96-4396-9061-1fd2ecc03fca', '77ad9ff5-c38b-4352-8d1a-272d13a7107f', '3aa86d81-0af3-4a35-8b41-fe52fd950441', '9a919081-da52-4efd-b8c6-4e814e2978a2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:17 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:17 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (f8774328-3ccc-420d-9fab-bf0d69e9f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae545e1d-359e-4df8-840f-7f8b5a61d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae545e1d-359e-4df8-840f-7f8b5a61d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943245799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8b7a67-1be7-446e-9d33-fd040f7f4e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:17Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87557e5-99b5-4e0a-83ca-fe192e54b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87557e5-99b5-4e0a-83ca-fe192e54b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84734cd3-47c5-47c7-83d0-2875db07ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84734cd3-47c5-47c7-83d0-2875db07ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8b7a67-1be7-446e-9d33-fd040f7f4e46', 'volume_name': 'volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d4bb86-924d-4ac7-bf91-311cc5317fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d4bb86-924d-4ac7-bf91-311cc5317fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5503917a-7559-47a4-8d14-037ec1c0520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:17 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Volume 1f8b7a67-1be7-446e-9d33-fd040f7f4e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46', 'volume_size': 1}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:17 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.301s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Deleted volume successfully.
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-beff2413-03fb-401b-a0e7-976a6b5305ee tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-13ac66a4-0be5-400b-a31e-6682927e5a39-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:17 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af 1073741824" returned: 0 in 0.685s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:17 devstack sudo[98495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af
Jul 23 03:24:17 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:17 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af" returned: 0 in 0.279s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943245799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8b7a67-1be7-446e-9d33-fd040f7f4e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:17Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Creating volume 1f8b7a67-1be7-446e-9d33-fd040f7f4e46 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:17 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b252b198-1747-4eb3-a2c3-9cb1ab520dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31411887-824b-4434-bcdd-924549e860af', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253c4b80-2d7f-4c76-85fc-499868826490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:17 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 1073741824
Jul 23 03:24:17 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:17 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Volume volume-31411887-824b-4434-bcdd-924549e860af (31411887-824b-4434-bcdd-924549e860af): created successfully
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253c4b80-2d7f-4c76-85fc-499868826490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Flow 'volume_create_manager' (c8dbe3aa-bb84-4af8-8a2a-b136ddfb31ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-02bc6602-cdb7-45fb-b743-bd8cf0445b01 tempest-VolumesListTestJSON-1751099449 None] Created volume successfully.
Jul 23 03:24:18 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 1073741824" returned: 0 in 0.809s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:18 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46
Jul 23 03:24:18 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:18 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Flow 'volume_create_manager' (07e6ca74-14b0-4f28-a0b2-ea5c8a283d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e083738-5f9d-4dd1-bd32-69ea74a89aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e083738-5f9d-4dd1-bd32-69ea74a89aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1294937775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b7eb24-433f-490d-91e3-d7cda5513485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05007dd76a3a43c18a67b9531365b491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:19Z,use_quota=True,user_id='9e808771cd7e4d9c98575b065244f244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f623b67-773b-438d-85e0-6a8359191fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:19 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f623b67-773b-438d-85e0-6a8359191fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f455a6b-5a17-4709-be04-8b884e428a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f455a6b-5a17-4709-be04-8b884e428a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b7eb24-433f-490d-91e3-d7cda5513485', 'volume_name': 'volume-a3b7eb24-433f-490d-91e3-d7cda5513485', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b465c72-7c47-4c9e-a365-6a93cee32359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b465c72-7c47-4c9e-a365-6a93cee32359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42139b-b17b-45f6-9e95-48576ca39f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Volume a3b7eb24-433f-490d-91e3-d7cda5513485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b7eb24-433f-490d-91e3-d7cda5513485', 'volume_size': 1}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46" returned: 0 in 0.410s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1294937775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b7eb24-433f-490d-91e3-d7cda5513485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05007dd76a3a43c18a67b9531365b491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:19Z,use_quota=True,user_id='9e808771cd7e4d9c98575b065244f244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Creating volume a3b7eb24-433f-490d-91e3-d7cda5513485 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:19 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5503917a-7559-47a4-8d14-037ec1c0520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a6992f-b41d-496e-876c-89effba0e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:19 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485 1073741824
Jul 23 03:24:19 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Volume volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 (1f8b7a67-1be7-446e-9d33-fd040f7f4e46): created successfully
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a6992f-b41d-496e-876c-89effba0e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (f8774328-3ccc-420d-9fab-bf0d69e9f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:19 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ba9f337c-406a-4772-a604-4537e2e76904 tempest-VolumesActionsTest-1589305460 None] Created volume successfully.
Jul 23 03:24:19 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485 1073741824" returned: 0 in 0.732s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:19 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485
Jul 23 03:24:19 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:20 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485" returned: 0 in 0.295s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42139b-b17b-45f6-9e95-48576ca39f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b7eb24-433f-490d-91e3-d7cda5513485', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f662eda-3e7d-4aae-b417-df591e428071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:20 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Volume volume-a3b7eb24-433f-490d-91e3-d7cda5513485 (a3b7eb24-433f-490d-91e3-d7cda5513485): created successfully
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f662eda-3e7d-4aae-b417-df591e428071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Flow 'volume_create_manager' (07e6ca74-14b0-4f28-a0b2-ea5c8a283d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-aee950bc-7a99-4a25-b5c2-e59a82d34ec7 tempest-VolumesTransfersV355Test-1215721215 None] Created volume successfully.
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-1f8b7a67-1be7-446e-9d33-fd040f7f4e46-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Lock "cinder-1f8b7a67-1be7-446e-9d33-fd040f7f4e46-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-quobyte-1f8b7a67-1be7-446e-9d33-fd040f7f4e46" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-1f8b7a67-1be7-446e-9d33-fd040f7f4e46" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc4724c-d679-438d-8480-0b4956a02a1c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:20 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46
Jul 23 03:24:20 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Acquiring lock "cinder-a3b7eb24-433f-490d-91e3-d7cda5513485-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-a3b7eb24-433f-490d-91e3-d7cda5513485-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Acquiring lock "cinder-quobyte-a3b7eb24-433f-490d-91e3-d7cda5513485" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-quobyte-a3b7eb24-433f-490d-91e3-d7cda5513485" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:21 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46" returned: 0 in 0.857s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68ef0d4-b2c7-468d-ae93-feda4b01c1c7]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:21 devstack sudo[98605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46
Jul 23 03:24:21 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:21 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485
Jul 23 03:24:21 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:21 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1f8b7a67-1be7-446e-9d33-fd040f7f4e46" returned: 0 in 0.391s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-1f8b7a67-1be7-446e-9d33-fd040f7f4e46" released by "delete_volume" :: held 1.322s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Created reservations ['5a36e09c-fc87-428d-803b-83efeca488b9', '4ae87260-57d5-4863-a822-962ecf7bac12', 'ca7671b3-805e-46e2-829a-1bd5f9df05dd', '888b433a-2b10-447b-a275-b4c23c3b0007'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:22 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485" returned: 0 in 0.633s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:22 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:22 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:22 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485
Jul 23 03:24:22 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "cinder-31411887-824b-4434-bcdd-924549e860af-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-31411887-824b-4434-bcdd-924549e860af-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "cinder-quobyte-31411887-824b-4434-bcdd-924549e860af" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:22 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a3b7eb24-433f-490d-91e3-d7cda5513485" returned: 0 in 0.427s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-quobyte-a3b7eb24-433f-490d-91e3-d7cda5513485" released by "delete_volume" :: held 1.126s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-quobyte-31411887-824b-4434-bcdd-924549e860af" acquired by "delete_volume" :: waited 0.054s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c729ea6-81ca-422b-8fc9-b16496514fbf]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-964fd7ae-4702-4e3d-bd1d-115d7fb662ea tempest-VolumesActionsTest-1237777530 None] Acquiring lock "cinder-eb2af8c7-8460-442d-977a-919f31697017" by "attach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:22 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.564s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-964fd7ae-4702-4e3d-bd1d-115d7fb662ea tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017" acquired by "attach_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Deleted volume successfully.
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-40cc7d95-05b6-480d-b868-897c2fd4dc5c tempest-VolumesActionsTest-837083907 None] Lock "cinder-1f8b7a67-1be7-446e-9d33-fd040f7f4e46-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Created reservations ['e770806b-0261-40cc-94b2-a090e0baadc4', 'ee92783d-ede7-4f08-bbed-4651cc906f4d', '736eca9e-062c-4fa2-9009-ab3ebb0d542f', '4e041d6c-07e3-45de-a6e8-2bceb134b6f6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-964fd7ae-4702-4e3d-bd1d-115d7fb662ea tempest-VolumesActionsTest-1237777530 None] Attaching volume eb2af8c7-8460-442d-977a-919f31697017 to instance ec601948-dd15-48ea-8ad6-b94a1427dd89 at mountpoint /dev/vdb on host None.
Jul 23 03:24:22 devstack sudo[98619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af
Jul 23 03:24:22 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-964fd7ae-4702-4e3d-bd1d-115d7fb662ea tempest-VolumesActionsTest-1237777530 None] Attach volume completed successfully.
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-964fd7ae-4702-4e3d-bd1d-115d7fb662ea tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017" released by "attach_volume" :: held 0.143s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:23 devstack sudo[98621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:23 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-81f841cd-ffa4-488c-8979-dbb23f4969db tempest-VolumesActionsTest-1237777530 None] Acquiring lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-detach_volume" by "detach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-81f841cd-ffa4-488c-8979-dbb23f4969db tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-81f841cd-ffa4-488c-8979-dbb23f4969db tempest-VolumesActionsTest-1237777530 None] Detaching volume eb2af8c7-8460-442d-977a-919f31697017 from instance ec601948-dd15-48ea-8ad6-b94a1427dd89.
Jul 23 03:24:23 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af" returned: 0 in 0.535s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-81f841cd-ffa4-488c-8979-dbb23f4969db tempest-VolumesActionsTest-1237777530 None] Detach volume completed successfully.
Jul 23 03:24:23 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af
Jul 23 03:24:23 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-81f841cd-ffa4-488c-8979-dbb23f4969db tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:23 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.398s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Deleted volume successfully.
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbf198e-c274-47e6-9d74-b0c309ac85de tempest-VolumesTransfersV355Test-1224621447 None] Lock "cinder-a3b7eb24-433f-490d-91e3-d7cda5513485-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:23 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-31411887-824b-4434-bcdd-924549e860af" returned: 0 in 0.554s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-quobyte-31411887-824b-4434-bcdd-924549e860af" released by "delete_volume" :: held 1.178s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Created reservations ['be08e5b3-763b-44eb-b392-6d15b7e63331', 'c130b74c-1f63-425c-acbc-52d4c027ac9b', '2e54c138-664a-43a5-a698-617d1b0c5ebf', '1a832db4-9bc3-4a88-bfc9-2b07d8d03125'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:24 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:24 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (35f297a9-1481-4577-8425-1569a2220d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf8c8ff-dc54-4340-ba91-5c31dd0b505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf8c8ff-dc54-4340-ba91-5c31dd0b505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-976863383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:24Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e257c1b3-faa7-420b-8b59-bfad2dd43ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e257c1b3-faa7-420b-8b59-bfad2dd43ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90648b0-1628-4778-9e84-4ec3320d86a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90648b0-1628-4778-9e84-4ec3320d86a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5', 'volume_name': 'volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfeace68-c24c-4828-b89a-031ced25ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfeace68-c24c-4828-b89a-031ced25ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373552ac-4642-4630-845d-a01d2cde4523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Volume eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5', 'volume_size': 1}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-976863383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:24Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Creating volume eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:24 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:24 devstack sudo[98640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 1073741824
Jul 23 03:24:24 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:24 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.512s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Deleted volume successfully.
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3072bd6-48c9-442f-8fc7-0a65380c783d tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-31411887-824b-4434-bcdd-924549e860af-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "cinder-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "cinder-quobyte-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:25 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 1073741824" returned: 0 in 0.774s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-quobyte-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ce4081-6f45-4407-b7ff-9a91b84f2c28]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:25 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5
Jul 23 03:24:25 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:25 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e
Jul 23 03:24:25 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:25 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5" returned: 0 in 0.312s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373552ac-4642-4630-845d-a01d2cde4523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f12ea2f-9c27-4ea2-b07d-e9dd03df64ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Volume volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 (eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5): created successfully
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f12ea2f-9c27-4ea2-b07d-e9dd03df64ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (35f297a9-1481-4577-8425-1569a2220d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=127,cinder:UPDATE=165,cinder:INSERT=42,cinder:DELETE=14 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:24:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1ab9c476-4bbf-4264-b5a1-8393ddc98c50 tempest-VolumesActionsTest-1589305460 None] Created volume successfully.
Jul 23 03:24:25 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e" returned: 0 in 0.673s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:25 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e
Jul 23 03:24:25 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:26 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e" returned: 0 in 0.272s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-quobyte-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e" released by "delete_volume" :: held 1.016s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Created reservations ['c4ae61e0-d69b-457c-84f4-896061999ec9', 'b54aecc2-a5ab-4c43-9bcf-c5db75550243', 'caf8e262-ee0d-491d-9b99-1d81ea92372a', '1270f3bb-d445-4afd-b6dc-1cbb2f9d0c8f'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:26 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:26 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Lock "cinder-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-quobyte-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:26 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.379s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Deleted volume successfully.
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[280aae48-386b-4b6b-8fcb-5ff7e77766fb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ab62bee-47e6-43e0-9a3c-85dd0c74d8bf tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-3ee7164d-d3ec-4b1a-a552-9edadf8ed54e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:26 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5
Jul 23 03:24:26 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:27 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5" returned: 0 in 0.415s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:27 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5
Jul 23 03:24:27 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "cinder-9407670f-f25c-4b15-9079-7519abbfdc76-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-9407670f-f25c-4b15-9079-7519abbfdc76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "cinder-quobyte-9407670f-f25c-4b15-9079-7519abbfdc76" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-quobyte-9407670f-f25c-4b15-9079-7519abbfdc76" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5952c4f-1b77-4ebf-a553-9695395e2a87]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:27 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5" released by "delete_volume" :: held 0.879s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Created reservations ['e24893b5-7133-49bd-ae38-b0f7bdfcb0ae', 'afaccfbb-57aa-49d8-a765-519ef09d5c03', '5e0c4f56-5ed2-404c-af68-18659833ece8', 'ae665af7-3c94-4d9c-b958-33ae49d23b10'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:27 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76
Jul 23 03:24:27 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:27 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:27 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:28 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76" returned: 0 in 0.521s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:28 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76
Jul 23 03:24:28 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:28 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.369s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Deleted volume successfully.
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-122367c8-014f-42d6-95f5-1c4dd9fa1b6c tempest-VolumesActionsTest-837083907 None] Lock "cinder-eabbb70b-3a33-47d1-b3fa-e5410ad5c9a5-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:28 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9407670f-f25c-4b15-9079-7519abbfdc76" returned: 0 in 0.361s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-quobyte-9407670f-f25c-4b15-9079-7519abbfdc76" released by "delete_volume" :: held 0.958s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Created reservations ['07da03a3-0d5b-482a-902f-077d4ff2fd3f', '58d4f16f-bf90-42c7-825a-9aa3bc123b82', 'b50939e2-3ec5-4069-8356-00b01ad6e0b8', 'ef26891a-0dfd-4c38-a9db-06eb9d9e729b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:28 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:28 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (c409a462-a0dc-47b0-9a9d-d105b571e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bd6cb6-b243-407c-ac09-d6188347a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bd6cb6-b243-407c-ac09-d6188347a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009967679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2924aa22-e223-4224-8070-d42d135224eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:29Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759b737f-6404-4f9b-b900-438b24d40ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759b737f-6404-4f9b-b900-438b24d40ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99dc0ac-07e1-48d0-a778-9b42fa433855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99dc0ac-07e1-48d0-a778-9b42fa433855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2924aa22-e223-4224-8070-d42d135224eb', 'volume_name': 'volume-2924aa22-e223-4224-8070-d42d135224eb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4062388-aa9e-4829-8505-9d859a7789ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4062388-aa9e-4829-8505-9d859a7789ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b0d16b-bdff-4b0a-86fd-0dad66d48849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:28 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Volume 2924aa22-e223-4224-8070-d42d135224eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2924aa22-e223-4224-8070-d42d135224eb', 'volume_size': 1}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009967679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2924aa22-e223-4224-8070-d42d135224eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:29Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Creating volume 2924aa22-e223-4224-8070-d42d135224eb {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:28 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:28 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb 1073741824
Jul 23 03:24:28 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:29 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:29 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Deleted volume successfully.
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1d393973-79ed-4884-80a6-8ad0fcd1f47c tempest-VolumesListTestJSON-1751099449 None] Lock "cinder-9407670f-f25c-4b15-9079-7519abbfdc76-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:29 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb 1073741824" returned: 0 in 0.624s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:29 devstack sudo[98713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb
Jul 23 03:24:29 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:29 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb" returned: 0 in 0.447s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b0d16b-bdff-4b0a-86fd-0dad66d48849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2924aa22-e223-4224-8070-d42d135224eb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65c2e6f-a650-4551-8760-46635e71b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:30 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Volume volume-2924aa22-e223-4224-8070-d42d135224eb (2924aa22-e223-4224-8070-d42d135224eb): created successfully
Jul 23 03:24:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65c2e6f-a650-4551-8760-46635e71b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (c409a462-a0dc-47b0-9a9d-d105b571e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e8d1f2ac-0009-4059-98fc-3534326f15e7 tempest-VolumesActionsTest-1589305460 None] Created volume successfully.
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-2924aa22-e223-4224-8070-d42d135224eb-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Lock "cinder-2924aa22-e223-4224-8070-d42d135224eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Acquiring lock "cinder-quobyte-2924aa22-e223-4224-8070-d42d135224eb" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-2924aa22-e223-4224-8070-d42d135224eb" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c49ca-e7d9-4559-b1a3-9859133b4576]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:31 devstack sudo[98766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb
Jul 23 03:24:31 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:31 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb" returned: 0 in 0.461s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:31 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb
Jul 23 03:24:31 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:32 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2924aa22-e223-4224-8070-d42d135224eb" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Lock "cinder-quobyte-2924aa22-e223-4224-8070-d42d135224eb" released by "delete_volume" :: held 0.873s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Created reservations ['0eaaf586-9770-40c1-9411-c07f6189a0d9', 'bc6d7c17-391c-4e89-9912-25aaf8c789eb', '096eaaad-0539-4b1b-93c2-77530f041f74', 'bbe79cb8-74f8-4511-9c3d-c7ad26a57c7a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:32 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:32 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:32 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.461s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Deleted volume successfully.
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a24a2690-69d7-43ff-9fae-a1e90b0e269a tempest-VolumesActionsTest-837083907 None] Lock "cinder-2924aa22-e223-4224-8070-d42d135224eb-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:32 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Flow 'volume_create_manager' (07ab0695-005c-4c37-8d49-4ed913bd3203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc2b556-2e8f-4dd9-91c4-17a2d3660245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc2b556-2e8f-4dd9-91c4-17a2d3660245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-26681654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cac716-2ffb-4a80-90ce-2875a79fd4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1903d3433c54c6ab384b3243ba60ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:33Z,use_quota=True,user_id='0b7c50aad08a43d48628b59972d6bf12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6045b606-68b6-40cf-8081-332b0310b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6045b606-68b6-40cf-8081-332b0310b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a4c397-0434-43a2-8c5a-d5d5859a34d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (8c6bdd85-b603-4636-8550-9f0685adb2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e07b7f4-acff-4f52-8c46-59b70fcad335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e07b7f4-acff-4f52-8c46-59b70fcad335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1654922396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff9ac90-fec9-4b61-b3c2-5865fe35efbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:34Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de4d35b-143c-439c-9de9-b1081bf2bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de4d35b-143c-439c-9de9-b1081bf2bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4b5b3b-21a4-4b72-9c70-bd3f6d6e6bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4b5b3b-21a4-4b72-9c70-bd3f6d6e6bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff9ac90-fec9-4b61-b3c2-5865fe35efbb', 'volume_name': 'volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53107877-fb86-45c3-b25f-e2a34bbe650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53107877-fb86-45c3-b25f-e2a34bbe650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a92282-34b6-46c0-ac74-197e186d109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Volume 0ff9ac90-fec9-4b61-b3c2-5865fe35efbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb', 'volume_size': 1}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1654922396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff9ac90-fec9-4b61-b3c2-5865fe35efbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a908a21c8aa24d6a8d64d45755bfdbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:34Z,use_quota=True,user_id='be9010d362124d46915439861cc89530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Creating volume 0ff9ac90-fec9-4b61-b3c2-5865fe35efbb {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:33 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:33 devstack sudo[98822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb 1073741824
Jul 23 03:24:33 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a4c397-0434-43a2-8c5a-d5d5859a34d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9cac716-2ffb-4a80-90ce-2875a79fd4c4', 'volume_name': 'volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693fafd610>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d21b1c-0061-480e-90df-2eef2700d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d21b1c-0061-480e-90df-2eef2700d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d017af-1cb2-477c-b73e-5efa0ee0832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:34 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Volume f9cac716-2ffb-4a80-90ce-2875a79fd4c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693fafd610>}
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Trying to clone f9cac716-2ffb-4a80-90ce-2875a79fd4c4 from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:24:34 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb 1073741824" returned: 0 in 0.747s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:34 devstack sudo[98856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb
Jul 23 03:24:34 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:24:34 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Image download 20.69 MB at 20.69 MB/s
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7602146-d3e3-4b93-b1dc-b0f14cea0d1d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:35 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD
Jul 23 03:24:35 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:35 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Flow 'volume_create_manager' (93d07e0d-b4fd-455f-acbf-cbaf62d79606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1675e123-bfaf-495c-bfd6-58cecbb9e354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb" returned: 0 in 0.372s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1675e123-bfaf-495c-bfd6-58cecbb9e354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-17110167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82804536-ff1e-4bcb-89a5-d79b60f12403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5514f0fbe41c4800aa951f0165e7c0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:35Z,use_quota=True,user_id='3cf8d16fdd4d4264a0621d067c3ffdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba6433f-cbd5-4ff3-b330-a9049d9b66bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba6433f-cbd5-4ff3-b330-a9049d9b66bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42e5c83-1e13-4c16-924f-43b1ff985b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42e5c83-1e13-4c16-924f-43b1ff985b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82804536-ff1e-4bcb-89a5-d79b60f12403', 'volume_name': 'volume-82804536-ff1e-4bcb-89a5-d79b60f12403', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25176444-da38-4590-8e8e-6b6f3e071f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25176444-da38-4590-8e8e-6b6f3e071f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77d6f5b-3a97-473a-9700-f2cf7e914112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:35 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Volume 82804536-ff1e-4bcb-89a5-d79b60f12403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82804536-ff1e-4bcb-89a5-d79b60f12403', 'volume_size': 1}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-17110167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82804536-ff1e-4bcb-89a5-d79b60f12403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5514f0fbe41c4800aa951f0165e7c0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:35Z,use_quota=True,user_id='3cf8d16fdd4d4264a0621d067c3ffdaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Creating volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:35 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a92282-34b6-46c0-ac74-197e186d109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd969a1-7f52-4099-ae1c-8ba80bc50257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:35 devstack sudo[98873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 1073741824
Jul 23 03:24:35 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:35 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Volume volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb (0ff9ac90-fec9-4b61-b3c2-5865fe35efbb): created successfully
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd969a1-7f52-4099-ae1c-8ba80bc50257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Flow 'volume_create_manager' (8c6bdd85-b603-4636-8550-9f0685adb2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:35 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-477ba6a5-58b9-4197-ad5e-11c70d4e05c3 tempest-VolumesActionsTest-1589305460 None] Created volume successfully.
Jul 23 03:24:35 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d is fetched for user 0b7c50aad08a43d48628b59972d6bf12. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[74538247-587a-4e8d-a713-0ae7017b651b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:35 devstack sudo[98879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD
Jul 23 03:24:35 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:35 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 1073741824" returned: 0 in 0.612s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:35 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403
Jul 23 03:24:35 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:36 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:36 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403" returned: 0 in 0.437s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-26681654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cac716-2ffb-4a80-90ce-2875a79fd4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1903d3433c54c6ab384b3243ba60ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:33Z,use_quota=True,user_id='0b7c50aad08a43d48628b59972d6bf12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Creating volume f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:24:36 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77d6f5b-3a97-473a-9700-f2cf7e914112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82804536-ff1e-4bcb-89a5-d79b60f12403', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:36 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 1073741824
Jul 23 03:24:36 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cecf727-0a75-4f56-bec2-f933f6f4a3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Volume volume-82804536-ff1e-4bcb-89a5-d79b60f12403 (82804536-ff1e-4bcb-89a5-d79b60f12403): created successfully
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cecf727-0a75-4f56-bec2-f933f6f4a3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Flow 'volume_create_manager' (93d07e0d-b4fd-455f-acbf-cbaf62d79606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b38a2498-3ef5-4131-87fe-fd54a7482f11 tempest-VolumesSnapshotListTestJSON-982723825 None] Created volume successfully.
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Acquiring lock "cinder-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Lock "cinder-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Acquiring lock "cinder-quobyte-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Lock "cinder-quobyte-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74bfa7c-6326-4da8-bdeb-4f82cbfdc030]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:36 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 1073741824" returned: 0 in 0.564s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:36 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4
Jul 23 03:24:36 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f8b10f06-e7ac-4ac8-bcb7-617a54e5716b tempest-VolumesActionsTest-1237777530 None] Acquiring lock "cinder-eb2af8c7-8460-442d-977a-919f31697017" by "attach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:37 devstack sudo[98898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb
Jul 23 03:24:37 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f8b10f06-e7ac-4ac8-bcb7-617a54e5716b tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017" acquired by "attach_volume" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f8b10f06-e7ac-4ac8-bcb7-617a54e5716b tempest-VolumesActionsTest-1237777530 None] Attaching volume eb2af8c7-8460-442d-977a-919f31697017 to instance c487ffd1-14cc-4ddd-b46b-dca336a94d80 at mountpoint /dev/vdb on host None.
Jul 23 03:24:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f8b10f06-e7ac-4ac8-bcb7-617a54e5716b tempest-VolumesActionsTest-1237777530 None] Attach volume completed successfully.
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f8b10f06-e7ac-4ac8-bcb7-617a54e5716b tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017" released by "attach_volume" :: held 0.159s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:37 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" returned: 0 in 0.477s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:37 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb" returned: 0 in 0.577s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e6fefb2-4e8e-4b26-bb2b-b5e22052cfba tempest-VolumesActionsTest-1237777530 None] Acquiring lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-detach_volume" by "detach_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:37 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb
Jul 23 03:24:37 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Attempting download of d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume f9cac716-2ffb-4a80-90ce-2875a79fd4c4. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e6fefb2-4e8e-4b26-bb2b-b5e22052cfba tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e6fefb2-4e8e-4b26-bb2b-b5e22052cfba tempest-VolumesActionsTest-1237777530 None] Detaching volume eb2af8c7-8460-442d-977a-919f31697017 from instance c487ffd1-14cc-4ddd-b46b-dca336a94d80.
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b98d32-7b1f-4231-af09-85534223e460]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Creating offline snapshot 2919c5c1-bd2a-4636-89b2-4f34d3e6a780 of volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a25f8c-81bd-42db-a675-f527596ae5d1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e6fefb2-4e8e-4b26-bb2b-b5e22052cfba tempest-VolumesActionsTest-1237777530 None] Detach volume completed successfully.
Jul 23 03:24:37 devstack sudo[98909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn
Jul 23 03:24:37 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e6fefb2-4e8e-4b26-bb2b-b5e22052cfba tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-detach_volume" released by "detach_volume" :: held 0.206s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:37 devstack sudo[98910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403
Jul 23 03:24:37 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:37 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb" returned: 0 in 0.506s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Lock "cinder-quobyte-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb" released by "delete_volume" :: held 1.134s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Created reservations ['2957e4b7-8b8d-4d55-a855-c5e70f5d7955', 'b9dbb7e1-49f0-449e-9a07-4ca408714bcb', 'f04e4c24-61b3-42f9-99d9-793d24b96c41', 'd917b22e-dee8-40c7-8680-c844899d30d2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:38 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn" returned: 0 in 0.456s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:38 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:38 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:38 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403" returned: 0 in 0.668s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:38 devstack sudo[98916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn
Jul 23 03:24:38 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:38 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 1G
Jul 23 03:24:38 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:38 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn" returned: 1 in 0.533s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_k2xt9dwn' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fae5d6-03d8-4358-bf1a-3a5e81b3f862]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:38 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.401s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Deleted volume successfully.
Jul 23 03:24:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-279a227f-8f84-49a6-9c99-c7bc4063013b tempest-VolumesActionsTest-1589305460 None] Lock "cinder-0ff9ac90-fec9-4b61-b3c2-5865fe35efbb-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:38 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD
Jul 23 03:24:38 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:39 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 1G" returned: 0 in 0.664s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:39 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:24:39 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:39 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] d528e14a-f1e8-46f0-b9e4-aded7536eb2d was qcow2, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:39 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4
Jul 23 03:24:39 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:39 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.417s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:39 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 is being set with open permissions: ugo+rw
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:39 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:24:39 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:39 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.432s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:39 devstack sudo[98981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info
Jul 23 03:24:39 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:40 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info" returned: 0 in 0.285s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:40 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info is being set with open permissions: ugo+rw
Jul 23 03:24:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:40 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info
Jul 23 03:24:40 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:40 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.info" returned: 0 in 0.331s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-16751291-7368-48a2-863f-620d4088bbfc tempest-VolumesSnapshotListTestJSON-982723825 None] Create snapshot completed successfully
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Creating offline snapshot 0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 of volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e1acd2-3386-47c8-9af1-626bd55d1fb0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:41 devstack sudo[98988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:24:41 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:41 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.493s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:41 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 1G
Jul 23 03:24:41 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:41 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" returned: 0 in 2.514s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_8s41vbxgdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:24:41 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Converted 112.00 MB image at 44.53 MB/s
Jul 23 03:24:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:41 devstack sudo[98996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 1G
Jul 23 03:24:41 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:42 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 1G" returned: 0 in 0.431s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Downloaded image d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume f9cac716-2ffb-4a80-90ce-2875a79fd4c4 successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d for user 0b7c50aad08a43d48628b59972d6bf12 is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Marking volume f9cac716-2ffb-4a80-90ce-2875a79fd4c4 as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Copying metadata from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d to f9cac716-2ffb-4a80-90ce-2875a79fd4c4. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Creating volume glance metadata for volume f9cac716-2ffb-4a80-90ce-2875a79fd4c4 backed by image d528e14a-f1e8-46f0-b9e4-aded7536eb2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:24:42 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 1G" returned: 0 in 0.572s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:42 devstack sudo[99005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:24:42 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d017af-1cb2-477c-b73e-5efa0ee0832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693fafd610>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0fe208-01ad-40e1-a123-77bd7af8f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Volume volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 (f9cac716-2ffb-4a80-90ce-2875a79fd4c4): created successfully
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0fe208-01ad-40e1-a123-77bd7af8f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Flow 'volume_create_manager' (07ab0695-005c-4c37-8d49-4ed913bd3203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cc01c2a1-f23a-4d9e-b224-fad84d92fe2f tempest-VolumesExtendTest-1648862608 None] Created volume successfully.
Jul 23 03:24:42 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 0.370s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:42 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 is being set with open permissions: ugo+rw
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:42 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:24:42 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:42 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 0.350s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.106s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2deb772-8e93-4970-a839-bbd623eb8df8]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-34130dd9-fc4c-4a59-a4d9-9babdaead698 tempest-VolumesSnapshotListTestJSON-982723825 None] Create snapshot completed successfully
Jul 23 03:24:43 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4
Jul 23 03:24:43 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:43 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" returned: 0 in 0.468s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 2G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 2G" returned: 0 in 0.099s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.588s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.618s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c1ae2-ea06-4f63-8114-e9ae7dd2dd69]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5d212242-4420-4b56-b0dd-31d1da393c87 tempest-VolumesExtendTest-1648862608 None] Extend volume completed successfully.
Jul 23 03:24:43 devstack sudo[99021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:24:43 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:43 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.451s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9bc556-84e7-4cfc-b22b-4162a76c07f4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:44 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:24:44 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-f9cac716-2ffb-4a80-90ce-2875a79fd4c4-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Lock "cinder-f9cac716-2ffb-4a80-90ce-2875a79fd4c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-quobyte-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a649605-e617-4acf-8d34-460fcf03628f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:44 devstack sudo[99029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4
Jul 23 03:24:44 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:44 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.422s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.932711dd-445f-4adf-a6f8-b1ad90cb7144wflji0oc.img {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:44 devstack sudo[99034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.932711dd-445f-4adf-a6f8-b1ad90cb7144wflji0oc.img
Jul 23 03:24:44 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:44 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" returned: 0 in 0.403s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:44 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4
Jul 23 03:24:44 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:45 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" returned: 0 in 0.707s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-f9cac716-2ffb-4a80-90ce-2875a79fd4c4" released by "delete_volume" :: held 1.179s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Created reservations ['82535dca-b440-4e36-8c1b-c01370e29209', '753c93d3-d746-4255-931f-33eda65f0b57', '51f21999-f902-42ac-b822-3dd440bc49d8', 'a727533d-b6d7-4b93-a66a-d4e3b879920b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:45 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:45 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:46 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.455s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:46 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Deleted volume successfully.
Jul 23 03:24:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d8f03f5b-00d0-4218-b73a-4193803eb58b tempest-VolumesExtendTest-1648862608 None] Lock "cinder-f9cac716-2ffb-4a80-90ce-2875a79fd4c4-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Flow 'volume_create_manager' (908d1605-0622-42b6-bc52-115a46c205c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c7763c-6875-4010-97aa-6a2aad974ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c7763c-6875-4010-97aa-6a2aad974ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-458291891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4602725-fb83-465f-8ae3-49e43d3f9ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1903d3433c54c6ab384b3243ba60ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:47Z,use_quota=True,user_id='0b7c50aad08a43d48628b59972d6bf12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea54c610-764b-433c-b46e-78182fa4edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea54c610-764b-433c-b46e-78182fa4edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7ec5b5-1adb-4235-bcc8-9189a7c7fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7ec5b5-1adb-4235-bcc8-9189a7c7fe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4602725-fb83-465f-8ae3-49e43d3f9ef2', 'volume_name': 'volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56b9d00-6cca-4a32-b2e1-76fe20db2105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56b9d00-6cca-4a32-b2e1-76fe20db2105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e422a90-145b-41a5-b235-b595cfcf4b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:47 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Volume c4602725-fb83-465f-8ae3-49e43d3f9ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2', 'volume_size': 1}
Jul 23 03:24:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:49 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.932711dd-445f-4adf-a6f8-b1ad90cb7144wflji0oc.img" returned: 0 in 4.722s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd1312-cfde-44b1-9bf9-9f62ff93db5d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:24:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:49 devstack sudo[99064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:24:49 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:49 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.562s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:49 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.932711dd-445f-4adf-a6f8-b1ad90cb7144wflji0oc.img {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:24:49 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Converted 1024.00 MB image at 216.80 MB/s
Jul 23 03:24:49 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] 932711dd-445f-4adf-a6f8-b1ad90cb7144 was raw, no need to convert to raw {{(pid=88344) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Flow 'volume_create_manager' (b1e87e0b-3da2-496e-bdaf-05fbb8a43276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a99654-2db1-4af7-ab03-d6d80cb443e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a99654-2db1-4af7-ab03-d6d80cb443e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1446152779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8111f8-dee8-425b-acbc-e51343060841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5ce5a0969140d6829640a5bae6f5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:55Z,use_quota=True,user_id='9e58ae7f0c2941f9a4babdcd16e9bb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbe0bf3-5708-45ed-896e-28e5f62f5f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbe0bf3-5708-45ed-896e-28e5f62f5f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fe4324-5e3d-4499-b491-d659ef3f9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fe4324-5e3d-4499-b491-d659ef3f9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a8111f8-dee8-425b-acbc-e51343060841', 'volume_name': 'volume-0a8111f8-dee8-425b-acbc-e51343060841', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dc1a9c-c2af-408d-b5a8-ec5310a6b006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dc1a9c-c2af-408d-b5a8-ec5310a6b006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c51a580-62eb-4073-b2c1-0a2abaae7264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:24:55 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Volume 0a8111f8-dee8-425b-acbc-e51343060841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a8111f8-dee8-425b-acbc-e51343060841', 'volume_size': 1}
Jul 23 03:24:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:24:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:24:58 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:24:58 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:24:59 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jul 23 03:24:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.266s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:24:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:24:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:24:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:24:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:25:05 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=139,cinder:DELETE=16,cinder:SELECT=105,cinder:INSERT=40 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:25:05 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.995s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Uploaded volume to glance image-id: 932711dd-445f-4adf-a6f8-b1ad90cb7144. {{(pid=88344) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.164s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Creating offline snapshot 195a10ea-8565-4906-9c25-6625d48e3fbc of volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:25:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9f025b91-6117-491c-8d15-bb7ccdc29b11 tempest-VolumesActionsTest-1237777530 None] Copy volume to image completed successfully.
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed585969-1bcd-4d4a-be39-e69f03d0c48d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:08 devstack sudo[99107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:25:08 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:08 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 0.388s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:09 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc 1G
Jul 23 03:25:09 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:09 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc 1G" returned: 0 in 0.609s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:09 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc
Jul 23 03:25:09 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:09 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:09 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc is being set with open permissions: ugo+rw
Jul 23 03:25:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:09 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc
Jul 23 03:25:09 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:10 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc" returned: 0 in 0.249s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.673s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.571s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-458291891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4602725-fb83-465f-8ae3-49e43d3f9ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1903d3433c54c6ab384b3243ba60ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:47Z,use_quota=True,user_id='0b7c50aad08a43d48628b59972d6bf12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Creating volume c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:10 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:10 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 1073741824
Jul 23 03:25:10 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-82ebc285-78b8-40b1-b2ad-9f49c1ce265e tempest-VolumesSnapshotListTestJSON-982723825 None] Create snapshot completed successfully
Jul 23 03:25:10 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 1073741824" returned: 0 in 0.506s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:10 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2
Jul 23 03:25:10 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:10 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2" returned: 0 in 0.246s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.516s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1446152779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8111f8-dee8-425b-acbc-e51343060841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5ce5a0969140d6829640a5bae6f5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:55Z,use_quota=True,user_id='9e58ae7f0c2941f9a4babdcd16e9bb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Creating volume 0a8111f8-dee8-425b-acbc-e51343060841 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:11 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:11 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841 1073741824
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e422a90-145b-41a5-b235-b595cfcf4b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:11 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1919d6-c498-492e-b259-14c8da3ba7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Volume volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 (c4602725-fb83-465f-8ae3-49e43d3f9ef2): created successfully
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1919d6-c498-492e-b259-14c8da3ba7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Flow 'volume_create_manager' (908d1605-0622-42b6-bc52-115a46c205c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e0eb4bb4-72e9-423a-ac2f-e02e6fcf7fa8 tempest-VolumesExtendTest-1648862608 None] Created volume successfully.
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-195a10ea-8565-4906-9c25-6625d48e3fbc-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-195a10ea-8565-4906-9c25-6625d48e3fbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-195a10ea-8565-4906-9c25-6625d48e3fbc" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-195a10ea-8565-4906-9c25-6625d48e3fbc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Deleting offline snapshot 195a10ea-8565-4906-9c25-6625d48e3fbc of volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] snapshot_file for this snap is: volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[936945b1-3803-4b0d-b61d-b7ea4487a4e9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:11 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841 1073741824" returned: 0 in 0.500s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:11 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc
Jul 23 03:25:11 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:11 devstack sudo[99535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841
Jul 23 03:25:11 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:11 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841" returned: 0 in 0.269s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.776s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:11 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc" returned: 0 in 0.377s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6511d2-05ff-45b9-a10c-af99c16c76e1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ea370d-ce60-48c5-88dd-e6bc545742b0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c51a580-62eb-4073-b2c1-0a2abaae7264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8111f8-dee8-425b-acbc-e51343060841', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd38b989-63b4-4f93-ae98-0eba1e7548bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Volume volume-0a8111f8-dee8-425b-acbc-e51343060841 (0a8111f8-dee8-425b-acbc-e51343060841): created successfully
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd38b989-63b4-4f93-ae98-0eba1e7548bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Flow 'volume_create_manager' (b1e87e0b-3da2-496e-bdaf-05fbb8a43276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fbf78594-a5cf-4db1-81c1-abce183ad34c tempest-VolumesListAdminTestJSON-659754117 None] Created volume successfully.
Jul 23 03:25:11 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:25:11 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:11 devstack sudo[99543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:25:11 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:12 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.413s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0d27f-2146-4515-a55b-3d42dbf66427]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:12 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 0.430s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:12 devstack sudo[99553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc
Jul 23 03:25:12 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:12 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:25:12 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:12 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.426s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:12 devstack sudo[99562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img
Jul 23 03:25:12 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:12 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc" returned: 0 in 0.448s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:12 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc
Jul 23 03:25:12 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Flow 'volume_create_manager' (85a565a9-18bc-482f-a015-ccfc9ef0bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:13 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2f8b52-b54b-4e3c-a54d-3a62486dfcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.195a10ea-8565-4906-9c25-6625d48e3fbc" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-195a10ea-8565-4906-9c25-6625d48e3fbc" released by "_delete_snapshot" :: held 1.727s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2f8b52-b54b-4e3c-a54d-3a62486dfcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-250789764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3172a2-da1b-4936-9abe-3dfd010b761b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5ce5a0969140d6829640a5bae6f5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:13Z,use_quota=True,user_id='9e58ae7f0c2941f9a4babdcd16e9bb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f8e0d4-2f52-4354-ac98-d73f7ecff9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f8e0d4-2f52-4354-ac98-d73f7ecff9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b936ca6b-5ec7-4093-85ab-0aec2fcc5d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b936ca6b-5ec7-4093-85ab-0aec2fcc5d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3172a2-da1b-4936-9abe-3dfd010b761b', 'volume_name': 'volume-0e3172a2-da1b-4936-9abe-3dfd010b761b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9257585d-f643-45c9-990f-a088d759b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9257585d-f643-45c9-990f-a088d759b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b09f74-4205-4489-804e-c8d413f2e0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:13 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Volume 0e3172a2-da1b-4936-9abe-3dfd010b761b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3172a2-da1b-4936-9abe-3dfd010b761b', 'volume_size': 1}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" released by "delete_snapshot" :: held 1.848s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Created reservations ['a634a130-eb51-4f3c-9b24-d3a268e27527', '440065c7-68b2-4bfa-926f-d80390450593', '043af1fd-90f4-4e7a-86e5-36de0590e886', '3ad80c63-d06a-47b9-9724-5ab749d63150'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:13 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Delete snapshot completed successfully.
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4f284b1f-b63d-4620-9ca4-959bf95a359a tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-195a10ea-8565-4906-9c25-6625d48e3fbc-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-0f3ea1a2-b317-4786-8dea-cc4fdd4266d1-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-0f3ea1a2-b317-4786-8dea-cc4fdd4266d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Deleting offline snapshot 0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 of volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] snapshot_file for this snap is: volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c48b57-c165-4b95-9941-3739daa64765]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:14 devstack sudo[99578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:25:14 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:14 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 1.062s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae05bf-e921-4847-9d1a-4cda76b62c09]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:15 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:25:15 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:15 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.824s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:15 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:25:15 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:16 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 0.825s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:16 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1
Jul 23 03:25:16 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:17 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" returned: 0 in 0.423s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-0f3ea1a2-b317-4786-8dea-cc4fdd4266d1" released by "_delete_snapshot" :: held 3.420s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" released by "delete_snapshot" :: held 3.476s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Created reservations ['1836e49c-0d1a-4509-b7cf-5bae596db06f', '9f9a3d98-b4f2-4ae8-9d27-82a18c15ce9a', 'cc294a6d-b821-4fa3-aad4-97f69c4a8a46', '6775ecfd-5c9f-4b2b-801b-beeeafd2537c'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:17 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img" returned: 0 in 4.706s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4957d9b9-68dc-442f-b1fb-b709d080a798]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Delete snapshot completed successfully.
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c89488-2b25-4a58-99ab-6fb336945e16 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-0f3ea1a2-b317-4786-8dea-cc4fdd4266d1-delete_snapshot" released by "delete_snapshot" :: held 3.740s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:17 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:25:17 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:17 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.558s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:25:17 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Converted 1024.00 MB image at 217.57 MB/s
Jul 23 03:25:17 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] 56471210-9261-41cd-91cc-8f361d9863e9 was raw, converting to qcow2 {{(pid=88344) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7456c56d-4108-41db-a1d1-c44670ea72b6]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:18 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img
Jul 23 03:25:18 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-2919c5c1-bd2a-4636-89b2-4f34d3e6a780-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-2919c5c1-bd2a-4636-89b2-4f34d3e6a780-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-2919c5c1-bd2a-4636-89b2-4f34d3e6a780" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-2919c5c1-bd2a-4636-89b2-4f34d3e6a780" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Deleting offline snapshot 2919c5c1-bd2a-4636-89b2-4f34d3e6a780 of volume 82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] snapshot_file for this snap is: volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba2a30b-6cb3-44af-8f95-4d287c8bb1d0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:18 devstack sudo[99606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:25:18 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:18 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:18 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img
Jul 23 03:25:18 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:18 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82804536-ff1e-4bcb-89a5-d79b60f12403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a8532-6658-477c-87bf-50f3393ea355]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:18 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img" returned: 1 in 0.356s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img /opt/stack/data/cinder/conversion/vol_upload_evci15d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:18 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img /opt/stack/data/cinder/conversion/vol_upload_evci15d6
Jul 23 03:25:18 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:18 devstack sudo[99616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403
Jul 23 03:25:18 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:18 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img /opt/stack/data/cinder/conversion/vol_upload_evci15d6" returned: 0 in 0.265s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Image conversion details: src /opt/stack/data/cinder/conversion/eb2af8c7-8460-442d-977a-919f31697017.temp_image.56471210-9261-41cd-91cc-8f361d9863e9cfuq4wv3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_evci15d6 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:25:18 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f5307-c263-4577-8883-6476f997614f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_evci15d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:19 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403" returned: 0 in 0.377s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:19 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:25:19 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:19 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_evci15d6
Jul 23 03:25:19 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:19 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_evci15d6" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:19 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.361s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:19 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780
Jul 23 03:25:19 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:19 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403.2919c5c1-bd2a-4636-89b2-4f34d3e6a780" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-2919c5c1-bd2a-4636-89b2-4f34d3e6a780" released by "_delete_snapshot" :: held 1.539s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" released by "delete_snapshot" :: held 1.566s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Created reservations ['22457d0b-a434-4744-a60d-f92069e7daac', '38dd2982-0c22-49c3-8048-40f7d8f1552b', '88cd50f4-a39c-4ae2-8a66-e7ca32b78d88', '22eb2af2-b068-40d4-a780-f8d1218d7453'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:19 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Delete snapshot completed successfully.
Jul 23 03:25:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5d5597-432b-429e-82c1-ae55cf31bb49 tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-2919c5c1-bd2a-4636-89b2-4f34d3e6a780-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-82804536-ff1e-4bcb-89a5-d79b60f12403-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-82804536-ff1e-4bcb-89a5-d79b60f12403-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b628291-e436-452f-b276-47b82aecb987]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:20 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403
Jul 23 03:25:20 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.019s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Uploaded volume to glance image-id: 56471210-9261-41cd-91cc-8f361d9863e9. {{(pid=88344) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.579s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Creating offline snapshot 9502bf5b-96cb-4388-9a0d-de35a4e526f5 of volume c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:25:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4f600ddb-2968-490c-8b15-0ff1465523b0 tempest-VolumesActionsTest-1237777530 None] Copy volume to image completed successfully.
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4cb765-27a6-4324-8c5b-1f199b9207db]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:20 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403" returned: 0 in 0.409s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:20 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403
Jul 23 03:25:20 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:20 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2
Jul 23 03:25:20 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:21 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-82804536-ff1e-4bcb-89a5-d79b60f12403" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-quobyte-82804536-ff1e-4bcb-89a5-d79b60f12403" released by "delete_volume" :: held 0.751s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Created reservations ['7825560a-6fc0-44c2-aa3c-4c980059f89a', '1a0874c8-4925-41ae-8c6e-88d19f633dcf', '4d0d6679-f5ca-4494-97d0-444c3912fe39', 'cfe94abb-8aa5-4591-af9c-c78fcef169e8'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:21 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2" returned: 0 in 0.379s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:21 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 1G
Jul 23 03:25:21 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:21 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:21 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:21 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.272s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:21 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Deleted volume successfully.
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2bfc403f-f00b-4b3f-9520-194eada0f7da tempest-VolumesSnapshotListTestJSON-982723825 None] Lock "cinder-82804536-ff1e-4bcb-89a5-d79b60f12403-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:21 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 1G" returned: 0 in 0.569s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:21 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5
Jul 23 03:25:21 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:22 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:22 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 is being set with open permissions: ugo+rw
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:22 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5
Jul 23 03:25:22 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "cinder-quobyte-eb2af8c7-8460-442d-977a-919f31697017" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Lock "cinder-quobyte-eb2af8c7-8460-442d-977a-919f31697017" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53982dc-8a93-4b48-ae96-a60195e3ac5b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:22 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5" returned: 0 in 0.381s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:22 devstack sudo[99673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info
Jul 23 03:25:22 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:22 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:25:22 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:22 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:22 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info is being set with open permissions: ugo+rw
Jul 23 03:25:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:22 devstack sudo[99679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info
Jul 23 03:25:22 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:23 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.506s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:23 devstack sudo[99683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017
Jul 23 03:25:23 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:23 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.info" returned: 0 in 0.321s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.046s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-250789764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3172a2-da1b-4936-9abe-3dfd010b761b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5ce5a0969140d6829640a5bae6f5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:13Z,use_quota=True,user_id='9e58ae7f0c2941f9a4babdcd16e9bb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Creating volume 0e3172a2-da1b-4936-9abe-3dfd010b761b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:23 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:23 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b 1073741824
Jul 23 03:25:23 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:23 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-eb2af8c7-8460-442d-977a-919f31697017" returned: 0 in 0.271s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9746fef6-4d02-4f3a-8074-c956dbac78f8 tempest-VolumesExtendTest-1648862608 None] Create snapshot completed successfully
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Lock "cinder-quobyte-eb2af8c7-8460-442d-977a-919f31697017" released by "delete_volume" :: held 0.839s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Created reservations ['a4231e97-1195-4324-8295-ec32ba114489', '8c4cca46-6564-4257-925b-e5b371ec3d07', 'de49950b-2251-4fd9-84de-316aa928baee', '236ff8f8-a54a-4c16-a6f3-37e431dddc07'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:23 devstack sudo[99691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:23 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:23 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b 1073741824" returned: 0 in 0.672s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:23 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.412s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:23 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Deleted volume successfully.
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6b460120-9214-46a6-8f65-93229904c3b9 tempest-VolumesActionsTest-1237777530 None] Lock "cinder-eb2af8c7-8460-442d-977a-919f31697017-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:24 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b
Jul 23 03:25:24 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:24 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b" returned: 0 in 0.293s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.265s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b09f74-4205-4489-804e-c8d413f2e0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3172a2-da1b-4936-9abe-3dfd010b761b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5ff2f9-feff-46ff-9d4e-f8e8e8759d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dbcf62-cb6f-4b7e-9c30-b1ab07f2cc85]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Volume volume-0e3172a2-da1b-4936-9abe-3dfd010b761b (0e3172a2-da1b-4936-9abe-3dfd010b761b): created successfully
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5ff2f9-feff-46ff-9d4e-f8e8e8759d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Flow 'volume_create_manager' (85a565a9-18bc-482f-a015-ccfc9ef0bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b20b9dbb-d0e7-40cb-b994-8541c0d1284d tempest-VolumesListAdminTestJSON-659754117 None] Created volume successfully.
Jul 23 03:25:24 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2
Jul 23 03:25:24 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:24 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 2G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 2G" returned: 0 in 0.191s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.688s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1bd58c7d-9683-4fbc-ab7e-f3c9932c208e tempest-VolumesExtendTest-1648862608 None] Extend volume completed successfully.
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-9502bf5b-96cb-4388-9a0d-de35a4e526f5-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Lock "cinder-9502bf5b-96cb-4388-9a0d-de35a4e526f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-quobyte-c4602725-fb83-465f-8ae3-49e43d3f9ef2" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-c4602725-fb83-465f-8ae3-49e43d3f9ef2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-quobyte-9502bf5b-96cb-4388-9a0d-de35a4e526f5" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-9502bf5b-96cb-4388-9a0d-de35a4e526f5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Deleting offline snapshot 9502bf5b-96cb-4388-9a0d-de35a4e526f5 of volume c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] snapshot_file for this snap is: volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f32d42-16b0-4531-aa3e-e2ecbc1daf22]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:25 devstack sudo[99710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5
Jul 23 03:25:25 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Flow 'volume_create_manager' (a96b63e7-25db-4cd8-9541-f18d498156ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457b0517-5fca-47a2-afaf-8e5c25d21ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457b0517-5fca-47a2-afaf-8e5c25d21ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-281259829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4c140f-759c-4443-aaa0-e2f871bd9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5ce5a0969140d6829640a5bae6f5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:26Z,use_quota=True,user_id='9e58ae7f0c2941f9a4babdcd16e9bb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2472cb-fbe3-497c-a951-03f95039140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2472cb-fbe3-497c-a951-03f95039140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88198f2e-e289-4901-91b4-e687ccb963f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88198f2e-e289-4901-91b4-e687ccb963f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4c140f-759c-4443-aaa0-e2f871bd9126', 'volume_name': 'volume-1b4c140f-759c-4443-aaa0-e2f871bd9126', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb37385a-5ff0-47de-a38b-000ef12ed467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb37385a-5ff0-47de-a38b-000ef12ed467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a010abf7-e8ba-40a6-b1a6-ce5d8fcb58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Volume 1b4c140f-759c-4443-aaa0-e2f871bd9126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4c140f-759c-4443-aaa0-e2f871bd9126', 'volume_size': 1}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-281259829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4c140f-759c-4443-aaa0-e2f871bd9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5ce5a0969140d6829640a5bae6f5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:26Z,use_quota=True,user_id='9e58ae7f0c2941f9a4babdcd16e9bb88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Creating volume 1b4c140f-759c-4443-aaa0-e2f871bd9126 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:25 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:26 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 1073741824
Jul 23 03:25:26 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:26 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5" returned: 0 in 0.515s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6db941-2c9e-4f1f-83f4-2805c01bb876]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:26 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2
Jul 23 03:25:26 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:26 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 1073741824" returned: 0 in 0.583s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:26 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126
Jul 23 03:25:26 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:26 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2" returned: 0 in 0.560s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:26 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5
Jul 23 03:25:26 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:26 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a010abf7-e8ba-40a6-b1a6-ce5d8fcb58a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4c140f-759c-4443-aaa0-e2f871bd9126', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af804aaf-f66b-424d-91a4-2a9fb862d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Volume volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 (1b4c140f-759c-4443-aaa0-e2f871bd9126): created successfully
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af804aaf-f66b-424d-91a4-2a9fb862d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Flow 'volume_create_manager' (a96b63e7-25db-4cd8-9541-f18d498156ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6db7f5ee-bcd3-4c98-a5eb-5293cefd6b8b tempest-VolumesListAdminTestJSON-659754117 None] Created volume successfully.
Jul 23 03:25:27 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5" returned: 0 in 0.496s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:27 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5
Jul 23 03:25:27 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:27 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2.9502bf5b-96cb-4388-9a0d-de35a4e526f5" returned: 0 in 0.329s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-9502bf5b-96cb-4388-9a0d-de35a4e526f5" released by "_delete_snapshot" :: held 2.094s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-c4602725-fb83-465f-8ae3-49e43d3f9ef2" released by "delete_snapshot" :: held 2.135s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Created reservations ['623ed313-0df6-4b4c-8f07-edc288e5c1b5', '66b5e0eb-2747-43aa-b7c9-1bd4ddbc8831', '5f9ccd47-6265-4c00-86f1-129c38c37fb5', '989c84ba-8ded-4749-a999-ff2bc8c47e08'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Delete snapshot completed successfully.
Jul 23 03:25:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05ff28fb-910e-417d-b192-6be587b8dad5 tempest-VolumesExtendTest-1648862608 None] Lock "cinder-9502bf5b-96cb-4388-9a0d-de35a4e526f5-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-c4602725-fb83-465f-8ae3-49e43d3f9ef2-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Lock "cinder-c4602725-fb83-465f-8ae3-49e43d3f9ef2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Acquiring lock "cinder-quobyte-c4602725-fb83-465f-8ae3-49e43d3f9ef2" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-c4602725-fb83-465f-8ae3-49e43d3f9ef2" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:28 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4c22ca-4da7-4b30-9f9c-55c0fbe4622d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Flow 'volume_create_manager' (da4a643d-8a6e-412a-bd9f-dd0a6d04c779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c95a874-75b6-4196-87bd-918704c45fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c95a874-75b6-4196-87bd-918704c45fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec113945-bd2c-48e1-bc54-d6ceedb99c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40114a9ac62640efb7a2a7bcf5b609b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:29Z,use_quota=True,user_id='ac8879fbe9fc42c7a49cc3e0b96bffa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b75488-d46a-46ed-86bb-b92dcf88e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b75488-d46a-46ed-86bb-b92dcf88e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee91b07c-8ab4-4a29-ad1d-184b1c85f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee91b07c-8ab4-4a29-ad1d-184b1c85f28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec113945-bd2c-48e1-bc54-d6ceedb99c9d', 'volume_name': 'volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:29 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2
Jul 23 03:25:29 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dbcc69-ccbe-4a93-b379-5cef9216098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dbcc69-ccbe-4a93-b379-5cef9216098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9ae57d-ab00-4da6-b502-8b0c805ae43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:29 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Volume ec113945-bd2c-48e1-bc54-d6ceedb99c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d', 'volume_size': 1}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec113945-bd2c-48e1-bc54-d6ceedb99c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40114a9ac62640efb7a2a7bcf5b609b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:29Z,use_quota=True,user_id='ac8879fbe9fc42c7a49cc3e0b96bffa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Creating volume ec113945-bd2c-48e1-bc54-d6ceedb99c9d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:29 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:29 devstack sudo[99741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d 1073741824
Jul 23 03:25:29 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:29 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2" returned: 0 in 0.492s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:29 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2
Jul 23 03:25:29 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:29 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d 1073741824" returned: 0 in 0.625s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:29 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c4602725-fb83-465f-8ae3-49e43d3f9ef2" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Lock "cinder-quobyte-c4602725-fb83-465f-8ae3-49e43d3f9ef2" released by "delete_volume" :: held 0.974s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:29 devstack sudo[99753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d
Jul 23 03:25:29 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:29 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Created reservations ['8521e06c-2232-4867-8911-7e26c075671a', 'f7be4976-5c27-42e4-8cc8-b4a9caff8a2e', '560db1d0-2688-45a7-a9cf-4347aa50b940', 'c853d3aa-d230-4673-948b-056c7f0a75a0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:30 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:30 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:30 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d" returned: 0 in 0.473s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9ae57d-ab00-4da6-b502-8b0c805ae43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c98d64-2721-4818-aaeb-57b5f68a8932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:30 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Volume volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d (ec113945-bd2c-48e1-bc54-d6ceedb99c9d): created successfully
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c98d64-2721-4818-aaeb-57b5f68a8932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Flow 'volume_create_manager' (da4a643d-8a6e-412a-bd9f-dd0a6d04c779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7cb5aef3-b944-45f6-bf1b-07b3ce5828d0 tempest-VolumesListAdminTestJSON-138513607 None] Created volume successfully.
Jul 23 03:25:30 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.440s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Deleted volume successfully.
Jul 23 03:25:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4efb4533-41a4-4f0b-8263-8b4e0d6d471f tempest-VolumesExtendTest-1648862608 None] Lock "cinder-c4602725-fb83-465f-8ae3-49e43d3f9ef2-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Acquiring lock "cinder-ec113945-bd2c-48e1-bc54-d6ceedb99c9d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Lock "cinder-ec113945-bd2c-48e1-bc54-d6ceedb99c9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Acquiring lock "cinder-quobyte-ec113945-bd2c-48e1-bc54-d6ceedb99c9d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Flow 'volume_create_manager' (01421ba0-56fb-4a3e-8c4d-afd3ab00225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa481c9e-1ce1-43f9-a314-9b9c40160b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Lock "cinder-quobyte-ec113945-bd2c-48e1-bc54-d6ceedb99c9d" acquired by "delete_volume" :: waited 0.062s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa481c9e-1ce1-43f9-a314-9b9c40160b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-747410911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d3234b-3ec5-4d89-b3dc-784532cb6f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d334a7facb5f451eab005835afad6d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:32Z,use_quota=True,user_id='9a4aa71722964c3e907fa57dbee1091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbebaa9-5c1e-48bd-92f9-309054357643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbebaa9-5c1e-48bd-92f9-309054357643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea31986-8735-4629-9038-61f07e1e5859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea31986-8735-4629-9038-61f07e1e5859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d3234b-3ec5-4d89-b3dc-784532cb6f7a', 'volume_name': 'volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a', 'volume_size': 2}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3105d6bc-f765-4cb7-b696-b40164c55dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3105d6bc-f765-4cb7-b696-b40164c55dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f014858-6e31-4ad1-93c5-11a71cb64171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:31 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Volume 29d3234b-3ec5-4d89-b3dc-784532cb6f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a', 'volume_size': 2}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-747410911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d3234b-3ec5-4d89-b3dc-784532cb6f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d334a7facb5f451eab005835afad6d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:32Z,use_quota=True,user_id='9a4aa71722964c3e907fa57dbee1091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Creating volume 29d3234b-3ec5-4d89-b3dc-784532cb6f7a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:31 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a 2147483648 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:31 devstack sudo[99793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a 2147483648
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6499da-d843-4724-8fdd-5baa6cdbe89e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:31 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "cinder-1b4c140f-759c-4443-aaa0-e2f871bd9126-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-1b4c140f-759c-4443-aaa0-e2f871bd9126-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "cinder-quobyte-1b4c140f-759c-4443-aaa0-e2f871bd9126" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-quobyte-1b4c140f-759c-4443-aaa0-e2f871bd9126" acquired by "delete_volume" :: waited 0.039s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:32 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d
Jul 23 03:25:32 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2caac2-1393-4e53-a7b0-718d2c17ec41]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:32 devstack sudo[99801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126
Jul 23 03:25:32 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:32 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d" returned: 0 in 0.644s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:32 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d
Jul 23 03:25:32 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:32 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a 2147483648" returned: 0 in 0.831s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:32 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a
Jul 23 03:25:32 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:32 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126" returned: 0 in 0.655s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:32 devstack sudo[99814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126
Jul 23 03:25:32 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:32 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ec113945-bd2c-48e1-bc54-d6ceedb99c9d" returned: 0 in 0.415s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Lock "cinder-quobyte-ec113945-bd2c-48e1-bc54-d6ceedb99c9d" released by "delete_volume" :: held 1.292s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Created reservations ['7b883d0d-a6a5-452d-8979-6a1874a12ee9', 'b74c0c2f-d9b3-48d1-b685-7305f6e54778', 'aad54a54-e4c8-483f-87e3-30df1fd153df', '9ae6e97d-a29c-44be-b4ff-a59f9f3e5d35'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:33 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a" returned: 0 in 0.347s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f014858-6e31-4ad1-93c5-11a71cb64171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a', 'volume_size': 2}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bfffb3-d7ca-4287-ac86-4a144f9bf81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Volume volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a (29d3234b-3ec5-4d89-b3dc-784532cb6f7a): created successfully
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bfffb3-d7ca-4287-ac86-4a144f9bf81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Flow 'volume_create_manager' (01421ba0-56fb-4a3e-8c4d-afd3ab00225d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-dbda0af7-9e2f-408d-877a-d3f81584a973 tempest-VolumesCloneNegativeTest-982610542 None] Created volume successfully.
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:33 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:33 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:33 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1b4c140f-759c-4443-aaa0-e2f871bd9126" returned: 0 in 0.536s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-quobyte-1b4c140f-759c-4443-aaa0-e2f871bd9126" released by "delete_volume" :: held 1.308s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Created reservations ['4c316348-d685-436c-9f6e-3cf53d1068dc', '603879a8-e5c1-43ed-94e7-93e18da57ad7', 'd937cc25-2459-45fe-a0f4-343c2c725395', '8fea6041-558e-4f5b-b5c7-229e8787d2b9'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:33 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Deleted volume successfully.
Jul 23 03:25:33 devstack sudo[99822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:33 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1e58b445-6dcc-493c-9ae4-02342849fead tempest-VolumesListAdminTestJSON-138513607 None] Lock "cinder-ec113945-bd2c-48e1-bc54-d6ceedb99c9d-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:33 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.382s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Deleted volume successfully.
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Acquiring lock "cinder-29d3234b-3ec5-4d89-b3dc-784532cb6f7a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-930680d2-0b63-493f-8249-1885f659a912 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-1b4c140f-759c-4443-aaa0-e2f871bd9126-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Lock "cinder-29d3234b-3ec5-4d89-b3dc-784532cb6f7a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Acquiring lock "cinder-quobyte-29d3234b-3ec5-4d89-b3dc-784532cb6f7a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Lock "cinder-quobyte-29d3234b-3ec5-4d89-b3dc-784532cb6f7a" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e54149-5a7f-4208-b82d-181595c50421]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "cinder-0e3172a2-da1b-4936-9abe-3dfd010b761b-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-0e3172a2-da1b-4936-9abe-3dfd010b761b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "cinder-quobyte-0e3172a2-da1b-4936-9abe-3dfd010b761b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-quobyte-0e3172a2-da1b-4936-9abe-3dfd010b761b" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:34 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a
Jul 23 03:25:34 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d5c87-c691-44fb-807e-b8109fe34191]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:34 devstack sudo[99827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b
Jul 23 03:25:34 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:34 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a" returned: 0 in 0.668s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:34 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a
Jul 23 03:25:34 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:34 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b" returned: 0 in 0.577s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:34 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b
Jul 23 03:25:34 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:35 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29d3234b-3ec5-4d89-b3dc-784532cb6f7a" returned: 0 in 0.361s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Lock "cinder-quobyte-29d3234b-3ec5-4d89-b3dc-784532cb6f7a" released by "delete_volume" :: held 1.103s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Created reservations ['17b3ae0e-3615-44ed-a20b-57d963a0263d', 'be394254-a440-4631-a132-ea38ada49027', '89626a45-0c77-4bf5-8dab-498c3e17aea4', 'e672be44-69df-4ddf-8079-afeb956f9837'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:35 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e3172a2-da1b-4936-9abe-3dfd010b761b" returned: 0 in 0.399s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-quobyte-0e3172a2-da1b-4936-9abe-3dfd010b761b" released by "delete_volume" :: held 1.057s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:35 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:35 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Created reservations ['30ae550b-edb7-4ac5-95fb-a040884402e3', 'a0702e33-1b6e-4a33-95f3-3149c4ef20bf', '9098b560-842e-4914-b808-75031603ae7a', 'a308dcf0-f1d9-46bc-8db9-55baca640a79'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:35 devstack sudo[99845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:35 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:35 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.387s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:35 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Deleted volume successfully.
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b6981354-2ea1-4cf3-a05a-4ecc896d644c tempest-VolumesCloneNegativeTest-982610542 None] Lock "cinder-29d3234b-3ec5-4d89-b3dc-784532cb6f7a-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:35 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:35 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Deleted volume successfully.
Jul 23 03:25:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f85110e8-210c-43c6-80a4-fabcac250bcb tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-0e3172a2-da1b-4936-9abe-3dfd010b761b-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "cinder-0a8111f8-dee8-425b-acbc-e51343060841-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-0a8111f8-dee8-425b-acbc-e51343060841-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "cinder-quobyte-0a8111f8-dee8-425b-acbc-e51343060841" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-quobyte-0a8111f8-dee8-425b-acbc-e51343060841" acquired by "delete_volume" :: waited 0.077s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (3d8ebc07-1299-472e-b8d3-25bfa63be505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69111fd-9147-42b5-9e90-36092cfc072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662c653-e7be-49e5-badf-85b42618701d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69111fd-9147-42b5-9e90-36092cfc072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1042893875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88add107-7f50-431f-a51a-680760516b3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:37Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe7ef74-1bb6-4093-97e5-0e192d26aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe7ef74-1bb6-4093-97e5-0e192d26aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd03291-426d-4d45-ac14-fa19dcb1906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd03291-426d-4d45-ac14-fa19dcb1906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88add107-7f50-431f-a51a-680760516b3a', 'volume_name': 'volume-88add107-7f50-431f-a51a-680760516b3a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc5026-83b9-4f5c-b9c9-39f3cb66f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc5026-83b9-4f5c-b9c9-39f3cb66f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7e8ff0-6066-49fb-a008-2cbe0bb2f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:37 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Volume 88add107-7f50-431f-a51a-680760516b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88add107-7f50-431f-a51a-680760516b3a', 'volume_size': 1}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1042893875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88add107-7f50-431f-a51a-680760516b3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:37Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Creating volume 88add107-7f50-431f-a51a-680760516b3a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:37 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:37 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a 1073741824
Jul 23 03:25:37 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:37 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841
Jul 23 03:25:37 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:37 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841" returned: 0 in 0.432s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:37 devstack sudo[99859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841
Jul 23 03:25:37 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:37 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a 1073741824" returned: 0 in 0.640s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:37 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0a8111f8-dee8-425b-acbc-e51343060841" returned: 0 in 0.322s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-quobyte-0a8111f8-dee8-425b-acbc-e51343060841" released by "delete_volume" :: held 0.836s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:37 devstack sudo[99863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a
Jul 23 03:25:37 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Created reservations ['72ec01aa-c5b3-489a-9564-107e131eef2e', 'bfcbf1da-fbf0-4946-b6c4-377ad8840f8c', '46318639-85d8-4a52-a7c4-1e9dba11ac61', 'bfd829d3-0905-46b1-a987-fb8f39f06fc2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:37 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:37 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:38 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7e8ff0-6066-49fb-a008-2cbe0bb2f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88add107-7f50-431f-a51a-680760516b3a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521883dc-386e-4105-a676-0d5daaaf767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Volume volume-88add107-7f50-431f-a51a-680760516b3a (88add107-7f50-431f-a51a-680760516b3a): created successfully
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521883dc-386e-4105-a676-0d5daaaf767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (3d8ebc07-1299-472e-b8d3-25bfa63be505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b4c6da82-a10b-47a5-9d3c-c3f3dcd39e7c tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:25:38 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.349s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Deleted volume successfully.
Jul 23 03:25:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97d428aa-94b5-46dd-95c5-581db74501e6 tempest-VolumesListAdminTestJSON-659754117 None] Lock "cinder-0a8111f8-dee8-425b-acbc-e51343060841-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (5c9d38f7-7ea1-4038-bcbb-9d4a9748f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe08a08-939c-461a-8742-522b47aeab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe08a08-939c-461a-8742-522b47aeab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1730605555',display_name='tempest-VolumesGetTest-Volume-1786248251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0e058c-e5e4-442f-8e60-7662ab21c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:40Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea875786-c973-48f1-ac70-8cfba676d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea875786-c973-48f1-ac70-8cfba676d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433c3411-5755-4a4e-884f-f2272d6f47cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433c3411-5755-4a4e-884f-f2272d6f47cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0e058c-e5e4-442f-8e60-7662ab21c5d0', 'volume_name': 'volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f774c4b3-4293-4faf-bb42-f064ab428904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f774c4b3-4293-4faf-bb42-f064ab428904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e61d465-b67d-40b4-87fb-e0010e929ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Volume 9e0e058c-e5e4-442f-8e60-7662ab21c5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0', 'volume_size': 1}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1730605555',display_name='tempest-VolumesGetTest-Volume-1786248251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0e058c-e5e4-442f-8e60-7662ab21c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:40Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Creating volume 9e0e058c-e5e4-442f-8e60-7662ab21c5d0 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:39 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:39 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 1073741824
Jul 23 03:25:39 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:40 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 1073741824" returned: 0 in 0.619s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:40 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0
Jul 23 03:25:40 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:40 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0" returned: 0 in 0.316s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e61d465-b67d-40b4-87fb-e0010e929ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509d591-2e8f-4fab-b2cd-da29fbd8bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Volume volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 (9e0e058c-e5e4-442f-8e60-7662ab21c5d0): created successfully
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9509d591-2e8f-4fab-b2cd-da29fbd8bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (5c9d38f7-7ea1-4038-bcbb-9d4a9748f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8af4a006-5977-431c-8dd2-424668a5659a tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-9e0e058c-e5e4-442f-8e60-7662ab21c5d0-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Lock "cinder-9e0e058c-e5e4-442f-8e60-7662ab21c5d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-9e0e058c-e5e4-442f-8e60-7662ab21c5d0" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-9e0e058c-e5e4-442f-8e60-7662ab21c5d0" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2e007-08db-4127-8a44-afe3304f0a3e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:42 devstack sudo[99878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0
Jul 23 03:25:42 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:42 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0" returned: 0 in 0.491s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:42 devstack sudo[99883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0
Jul 23 03:25:42 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:42 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9e0e058c-e5e4-442f-8e60-7662ab21c5d0" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-9e0e058c-e5e4-442f-8e60-7662ab21c5d0" released by "delete_volume" :: held 0.831s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Created reservations ['d3b85a50-8f18-48fd-80d6-7cbfa413d920', '54720761-6b10-4242-9bbf-2e695bcc545e', '1a2b1798-0181-4788-b090-6248db6a24a2', 'c22eb764-ed74-4299-8fa0-5a7502d840c0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:43 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:43 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-88add107-7f50-431f-a51a-680760516b3a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Lock "cinder-88add107-7f50-431f-a51a-680760516b3a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-88add107-7f50-431f-a51a-680760516b3a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-88add107-7f50-431f-a51a-680760516b3a" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:43 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.475s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ce301-5d58-492a-9e38-1443040c2570]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0408b440-6c91-40a8-b632-b7af88d42360 tempest-VolumesGetTest-1236621928 None] Lock "cinder-9e0e058c-e5e4-442f-8e60-7662ab21c5d0-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:43 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a
Jul 23 03:25:43 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:44 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a" returned: 0 in 0.444s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:44 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a
Jul 23 03:25:44 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:44 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88add107-7f50-431f-a51a-680760516b3a" returned: 0 in 0.342s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-88add107-7f50-431f-a51a-680760516b3a" released by "delete_volume" :: held 0.869s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Created reservations ['f6c12e33-a795-4e00-ba1a-a72a6814ac1a', '83a7d73c-1396-4b38-acf4-8e0cf26cd06a', '64d09480-9702-4fbf-9837-b87978c01c58', 'cfc04468-3e9f-4d0c-8e83-040f7e96f1e5'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:44 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:44 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:45 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-28b5af57-4f2d-4290-a06b-e495d64be184 tempest-VolumesGetTest-1236621928 None] Lock "cinder-88add107-7f50-431f-a51a-680760516b3a-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (24be398b-1375-44de-97c7-892c09d3aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797469f5-3d41-4c0e-96ef-1507828a0dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797469f5-3d41-4c0e-96ef-1507828a0dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-192465539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2afe0e-f662-462d-9d91-6b06840e308d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:45Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33185afd-400c-4d5b-852f-cb960c0fb897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33185afd-400c-4d5b-852f-cb960c0fb897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df69804-a573-45c6-a6aa-65f20a2d3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df69804-a573-45c6-a6aa-65f20a2d3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2afe0e-f662-462d-9d91-6b06840e308d', 'volume_name': 'volume-7d2afe0e-f662-462d-9d91-6b06840e308d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc78cd-1a1f-4657-862d-08ebf380c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc78cd-1a1f-4657-862d-08ebf380c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaf6308-3737-4266-b612-41fd0cd16d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:45 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Volume 7d2afe0e-f662-462d-9d91-6b06840e308d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2afe0e-f662-462d-9d91-6b06840e308d', 'volume_size': 1}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-192465539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2afe0e-f662-462d-9d91-6b06840e308d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:45Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Creating volume 7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:25:45 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:25:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:45 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d 1073741824
Jul 23 03:25:45 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:46 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d 1073741824" returned: 0 in 0.588s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:46 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:25:46 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:46 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.298s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaf6308-3737-4266-b612-41fd0cd16d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2afe0e-f662-462d-9d91-6b06840e308d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d671882-4221-4344-9601-303da46c497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:46 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Volume volume-7d2afe0e-f662-462d-9d91-6b06840e308d (7d2afe0e-f662-462d-9d91-6b06840e308d): created successfully
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d671882-4221-4344-9601-303da46c497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (24be398b-1375-44de-97c7-892c09d3aa89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-422156bb-adc8-45c7-aed8-423be2c3f561 tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (cf2d4e5d-3f2b-4967-8371-8821bdac9b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f31116-acfe-4b0f-9603-fbbc3b349d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f31116-acfe-4b0f-9603-fbbc3b349d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1207062163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bfd09a-6c04-4ec4-b8f6-78a4882dc595,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=7d2afe0e-f662-462d-9d91-6b06840e308d,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:48Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cec13b3-afcc-4d5d-bb34-bbaad8f0cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cec13b3-afcc-4d5d-bb34-bbaad8f0cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c1c47e-f3ac-434f-9534-afeeec1044b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c1c47e-f3ac-434f-9534-afeeec1044b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c5bfd09a-6c04-4ec4-b8f6-78a4882dc595', 'volume_name': 'volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595', 'volume_size': 1, 'source_volid': '7d2afe0e-f662-462d-9d91-6b06840e308d', 'source_volstatus': 'available'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cce47d-d771-4ee0-8d07-7a55bfbce19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cce47d-d771-4ee0-8d07-7a55bfbce19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fa1a15-e1bb-4260-bd58-c07e099428a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:48 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Volume c5bfd09a-6c04-4ec4-b8f6-78a4882dc595: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595', 'volume_size': 1, 'source_volid': '7d2afe0e-f662-462d-9d91-6b06840e308d', 'source_volstatus': 'available'}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:48 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Cloning volume 7d2afe0e-f662-462d-9d91-6b06840e308d to volume c5bfd09a-6c04-4ec4-b8f6-78a4882dc595
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Creating offline snapshot 1d9c9c90-81d5-4efa-885a-a3d5c3464f5d of volume 7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[da821e95-a053-4ef3-86b5-e0ee30eb9f0e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:48 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:25:49 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Flow 'volume_create_manager' (2784cdd6-df3c-44ba-a41d-d8207c71d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92db5ba2-3ef7-4c1f-8051-338d1b453c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92db5ba2-3ef7-4c1f-8051-338d1b453c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1292535905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e00d1bf-dbbc-485a-948f-68b43bd9f937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff8058965bb4b3d9b3fd03d13ab5fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:49Z,use_quota=True,user_id='22739a69225c4b638765c673419ab279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25250afb-48b3-4719-a4ad-1d10a4d29ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25250afb-48b3-4719-a4ad-1d10a4d29ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205b7a3f-c6cb-44a7-965e-b2fd2c0cf493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205b7a3f-c6cb-44a7-965e-b2fd2c0cf493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e00d1bf-dbbc-485a-948f-68b43bd9f937', 'volume_name': 'volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b6db2a-8890-4685-ad28-f8545223709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b6db2a-8890-4685-ad28-f8545223709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dee2b1-6218-456b-a078-5536e4d3f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Volume 1e00d1bf-dbbc-485a-948f-68b43bd9f937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937', 'volume_size': 1}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:49 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.581s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:49 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d 1G
Jul 23 03:25:49 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Flow 'volume_create_manager' (eca0559b-3327-4328-918f-107ed9b4501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214b9ea2-d22e-47fe-9137-f229256e345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214b9ea2-d22e-47fe-9137-f229256e345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-822363216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f5b5fc-dec6-4b80-b555-4e7b8668fdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff8058965bb4b3d9b3fd03d13ab5fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:50Z,use_quota=True,user_id='22739a69225c4b638765c673419ab279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec09883-d25d-4aed-b95a-532809013a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec09883-d25d-4aed-b95a-532809013a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894e15e5-5adc-4291-b7e8-a9ea6011a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894e15e5-5adc-4291-b7e8-a9ea6011a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f5b5fc-dec6-4b80-b555-4e7b8668fdac', 'volume_name': 'volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d525a103-b273-4172-89e9-daf1ac5b2f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d525a103-b273-4172-89e9-daf1ac5b2f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad64ac7-6a29-48b6-a916-973c420b4681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:49 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Volume 80f5b5fc-dec6-4b80-b555-4e7b8668fdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac', 'volume_size': 1}
Jul 23 03:25:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:50 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d 1G" returned: 0 in 0.648s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d2afe0e-f662-462d-9d91-6b06840e308d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:50 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d2afe0e-f662-462d-9d91-6b06840e308d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d
Jul 23 03:25:50 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:50 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d2afe0e-f662-462d-9d91-6b06840e308d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" returned: 0 in 0.390s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:50 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d is being set with open permissions: ugo+rw
Jul 23 03:25:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:50 devstack sudo[99932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d
Jul 23 03:25:50 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:50 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" returned: 0 in 0.304s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:50 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info
Jul 23 03:25:50 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:51 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:51 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info is being set with open permissions: ugo+rw
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:51 devstack sudo[99938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info
Jul 23 03:25:51 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:51 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.info" returned: 0 in 0.278s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] snapshot: 1d9c9c90-81d5-4efa-885a-a3d5c3464f5d, volume: c5bfd09a-6c04-4ec4-b8f6-78a4882dc595,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117f0a2-01fb-4980-b757-a4d88e6c4335]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:51 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d
Jul 23 03:25:51 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:51 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" returned: 0 in 0.500s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2afe0e-f662-462d-9d91-6b06840e308d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc735a1-5d48-4eb7-9568-ce9fb6d45851]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:52 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:25:52 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:52 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.479s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:52 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:25:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:52 devstack sudo[99951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595
Jul 23 03:25:52 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Flow 'volume_create_manager' (ee189015-2082-43ce-b2b6-9815cf3f9213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fea444-6d3f-4819-9161-0f2e40989e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fea444-6d3f-4819-9161-0f2e40989e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1276808434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88172f3-2da8-4289-83dd-4b26680abf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66c052bd8a041ea87410314c3266be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:56Z,use_quota=True,user_id='241d5597a77b4a2dacac09fc2f600a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d07fb26-100b-4822-a0f6-f62f7a098610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d07fb26-100b-4822-a0f6-f62f7a098610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22071be-7969-4320-a76d-aa7a4f5def30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22071be-7969-4320-a76d-aa7a4f5def30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88172f3-2da8-4289-83dd-4b26680abf10', 'volume_name': 'volume-f88172f3-2da8-4289-83dd-4b26680abf10', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0f90d8-ffd6-4ad6-908b-cfb6b7a16b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0f90d8-ffd6-4ad6-908b-cfb6b7a16b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52721884-d817-4659-958a-62ae8cc26f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:25:56 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Volume f88172f3-2da8-4289-83dd-4b26680abf10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88172f3-2da8-4289-83dd-4b26680abf10', 'volume_size': 1}
Jul 23 03:25:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:57 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" returned: 0 in 5.499s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:57 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a90cee-cc1a-4153-8e19-802b162839a3]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:58 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:25:58 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:58 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.656s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:25:58 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Converted 1024.00 MB image at 186.18 MB/s
Jul 23 03:25:58 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 is being set with open permissions: ugo+rw
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:58 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595
Jul 23 03:25:58 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:58 devstack sudo[99975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:25:58 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:58 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" released by "_copy_volume_from_snapshot" :: held 7.549s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Deleting offline snapshot 1d9c9c90-81d5-4efa-885a-a3d5c3464f5d of volume 7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:25:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] snapshot_file for this snap is: volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[031bf8b1-1e75-42cc-96af-2a00a6b9be6e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:59 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:25:59 devstack sudo[99978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d
Jul 23 03:25:59 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:25:59 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" returned: 0 in 0.489s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2afe0e-f662-462d-9d91-6b06840e308d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de7a4c-8630-4b2b-b622-176cf6b674fb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:25:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:25:59 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:25:59 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:00 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.503s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:00 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d
Jul 23 03:26:00 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:00 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" returned: 0 in 0.517s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:00 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d
Jul 23 03:26:00 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:00 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d.1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" returned: 0 in 0.349s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-1d9c9c90-81d5-4efa-885a-a3d5c3464f5d" released by "_delete_snapshot" :: held 2.001s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.306s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.703s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1292535905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e00d1bf-dbbc-485a-948f-68b43bd9f937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff8058965bb4b3d9b3fd03d13ab5fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:49Z,use_quota=True,user_id='22739a69225c4b638765c673419ab279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Creating volume 1e00d1bf-dbbc-485a-948f-68b43bd9f937 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:01 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fa1a15-e1bb-4260-bd58-c07e099428a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595', 'volume_size': 1, 'source_volid': '7d2afe0e-f662-462d-9d91-6b06840e308d', 'source_volstatus': 'available'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:01 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 1073741824
Jul 23 03:26:01 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018c00c7-ac7a-48e6-8da8-e6d21f2100d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Volume volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 (c5bfd09a-6c04-4ec4-b8f6-78a4882dc595): created successfully
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018c00c7-ac7a-48e6-8da8-e6d21f2100d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (cf2d4e5d-3f2b-4967-8371-8821bdac9b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4e0b31dc-a68d-48c0-87b7-4f6782013dc5 tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:26:01 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 1073741824" returned: 0 in 0.531s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:01 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937
Jul 23 03:26:01 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:01 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937" returned: 0 in 0.329s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.144s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-822363216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f5b5fc-dec6-4b80-b555-4e7b8668fdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff8058965bb4b3d9b3fd03d13ab5fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:50Z,use_quota=True,user_id='22739a69225c4b638765c673419ab279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Creating volume 80f5b5fc-dec6-4b80-b555-4e7b8668fdac {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:01 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dee2b1-6218-456b-a078-5536e4d3f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:02 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac 1073741824
Jul 23 03:26:02 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98724cbf-423e-4e79-a907-9220e5f3242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:02 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Volume volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 (1e00d1bf-dbbc-485a-948f-68b43bd9f937): created successfully
Jul 23 03:26:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98724cbf-423e-4e79-a907-9220e5f3242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Flow 'volume_create_manager' (2784cdd6-df3c-44ba-a41d-d8207c71d897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1bf47ceb-8106-47d7-ba19-048654e51cf2 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Created volume successfully.
Jul 23 03:26:02 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac 1073741824" returned: 0 in 0.763s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:02 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac
Jul 23 03:26:02 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (89fc63ed-fbac-49d3-9c6a-6901ffd17f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba92916-adfd-47db-9ce5-e1f9316d9299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba92916-adfd-47db-9ce5-e1f9316d9299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1066741069',display_name='tempest-VolumesGetTest-Volume-2062142705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:03Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e085a9bd-eb54-4641-8c68-8ff02e6823cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e085a9bd-eb54-4641-8c68-8ff02e6823cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaef3771-9f4e-4549-8986-a83d530ce378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaef3771-9f4e-4549-8986-a83d530ce378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d', 'volume_name': 'volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6cf243-7842-4cfe-a2eb-f468d3bae902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6cf243-7842-4cfe-a2eb-f468d3bae902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:03 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddebd5d-395f-485f-9222-5274964502b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:03 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Volume ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d', 'volume_size': 1}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac" returned: 0 in 0.422s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.733s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1276808434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88172f3-2da8-4289-83dd-4b26680abf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66c052bd8a041ea87410314c3266be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:56Z,use_quota=True,user_id='241d5597a77b4a2dacac09fc2f600a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Creating volume f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:03 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad64ac7-6a29-48b6-a916-973c420b4681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:03 devstack sudo[100036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 1073741824
Jul 23 03:26:03 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9055b1d-aa50-49a8-81db-4455eba993bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:03 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Volume volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac (80f5b5fc-dec6-4b80-b555-4e7b8668fdac): created successfully
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9055b1d-aa50-49a8-81db-4455eba993bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Flow 'volume_create_manager' (eca0559b-3327-4328-918f-107ed9b4501c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-24c0bf49-a65d-47fb-b322-5def3866723d tempest-TestServerVolumeAttachmentScenario-2060676250 None] Created volume successfully.
Jul 23 03:26:04 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 1073741824" returned: 0 in 1.134s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:04 devstack sudo[100099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10
Jul 23 03:26:04 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:04 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10" returned: 0 in 0.304s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1066741069',display_name='tempest-VolumesGetTest-Volume-2062142705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:03Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Creating volume ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:04 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:04 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d 1073741824
Jul 23 03:26:04 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52721884-d817-4659-958a-62ae8cc26f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88172f3-2da8-4289-83dd-4b26680abf10', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c308ca8a-bd27-4566-b247-70af24227bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:04 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Volume volume-f88172f3-2da8-4289-83dd-4b26680abf10 (f88172f3-2da8-4289-83dd-4b26680abf10): created successfully
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c308ca8a-bd27-4566-b247-70af24227bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Flow 'volume_create_manager' (ee189015-2082-43ce-b2b6-9815cf3f9213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:04 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fcb214bd-13fb-4579-b8f4-047f5f122703 tempest-SnapshotMetadataTestJSON-1632890339 None] Created volume successfully.
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:05 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d 1073741824" returned: 0 in 0.738s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=107,cinder:UPDATE=160,cinder:DELETE=14,cinder:INSERT=33 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=111,cinder:UPDATE=138,cinder:DELETE=11,cinder:INSERT=39 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:05 devstack sudo[100135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d
Jul 23 03:26:05 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:05 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.483s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddebd5d-395f-485f-9222-5274964502b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a683dbd-2b14-45a4-8af9-f0d8e5cef6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Creating offline snapshot 378ad959-313f-41f1-95bf-5c9e4d053a37 of volume f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:26:05 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Volume volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d (ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d): created successfully
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a683dbd-2b14-45a4-8af9-f0d8e5cef6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (89fc63ed-fbac-49d3-9c6a-6901ffd17f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198a697-9135-4b41-8d12-58520d0ccff6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:06 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e5ffd3a6-a0bb-45d1-a481-ea47db17af62 tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:26:06 devstack sudo[100139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10
Jul 23 03:26:06 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Lock "cinder-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:06 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10" returned: 0 in 0.749s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d" acquired by "delete_volume" :: waited 0.071s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:06 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 1G
Jul 23 03:26:06 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9482d9a-0412-42fc-9089-94e468fcf538]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:07 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d
Jul 23 03:26:07 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:07 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 1G" returned: 0 in 0.680s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88172f3-2da8-4289-83dd-4b26680abf10 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:07 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88172f3-2da8-4289-83dd-4b26680abf10 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37
Jul 23 03:26:07 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:07 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d" returned: 0 in 0.733s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:07 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d
Jul 23 03:26:07 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:07 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f88172f3-2da8-4289-83dd-4b26680abf10 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37" returned: 0 in 0.492s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:07 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 is being set with open permissions: ugo+rw
Jul 23 03:26:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:07 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37
Jul 23 03:26:07 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:08 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d" returned: 0 in 0.542s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d" released by "delete_volume" :: held 1.340s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Created reservations ['190224e1-1dae-479c-afc2-1da13c537168', '628dcb65-f174-4f3f-8139-067f1cb01845', '79c84fe7-1b19-4e5f-bc66-b08c377c5d18', '61696261-787c-4930-aa30-c670fa1deb44'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:08 devstack sudo[100166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:08 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:08 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37" returned: 0 in 0.636s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:08 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info
Jul 23 03:26:08 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:08 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.494s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:26:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-515133d3-6118-4fb9-a2c5-4eac65f0e53f tempest-VolumesGetTest-1236621928 None] Lock "cinder-ff5aadd2-19c3-4bbe-acd5-d2fb0f0ec69d-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:09 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info" returned: 0 in 0.497s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:09 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info is being set with open permissions: ugo+rw
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:09 devstack sudo[100173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info
Jul 23 03:26:09 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Lock "cinder-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[be236f10-1e7d-493a-83f1-715d9d404b95]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:09 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:09 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595
Jul 23 03:26:09 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.info" returned: 0 in 0.609s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.887s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:09 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5945f6da-7387-4092-9512-25ecc451025d tempest-SnapshotMetadataTestJSON-1632890339 None] Create snapshot completed successfully
Jul 23 03:26:10 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" returned: 0 in 0.539s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:10 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595
Jul 23 03:26:10 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:10 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" returned: 0 in 0.316s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595" released by "delete_volume" :: held 0.928s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Created reservations ['cc9bff94-a4c9-4eda-b2a0-b1dc0d2fe98b', '7b3273e1-9c9d-4d9b-816b-2511c5d7b1ad', '17592a26-2411-4f35-ae60-6b16ad778312', 'd2adb39d-362c-4a59-a048-408eafc7556c'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:10 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:10 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:10 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:26:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7905996d-8f9b-41b4-90d0-06560b98bcfd tempest-VolumesGetTest-1236621928 None] Lock "cinder-c5bfd09a-6c04-4ec4-b8f6-78a4882dc595-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-7d2afe0e-f662-462d-9d91-6b06840e308d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Lock "cinder-7d2afe0e-f662-462d-9d91-6b06840e308d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-7d2afe0e-f662-462d-9d91-6b06840e308d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-7d2afe0e-f662-462d-9d91-6b06840e308d" acquired by "delete_volume" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[51573cba-d88b-4f32-b4f3-0e42d3ffdd03]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:12 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:26:12 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "cinder-378ad959-313f-41f1-95bf-5c9e4d053a37-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-378ad959-313f-41f1-95bf-5c9e4d053a37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "cinder-quobyte-f88172f3-2da8-4289-83dd-4b26680abf10" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-quobyte-f88172f3-2da8-4289-83dd-4b26680abf10" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "cinder-quobyte-378ad959-313f-41f1-95bf-5c9e4d053a37" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-quobyte-378ad959-313f-41f1-95bf-5c9e4d053a37" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Deleting offline snapshot 378ad959-313f-41f1-95bf-5c9e4d053a37 of volume f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] snapshot_file for this snap is: volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f0aba-7219-447b-9a21-975e7cb27190]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:12 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.581s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:12 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d
Jul 23 03:26:12 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:12 devstack sudo[100203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37
Jul 23 03:26:12 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:13 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7d2afe0e-f662-462d-9d91-6b06840e308d" returned: 0 in 0.481s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-7d2afe0e-f662-462d-9d91-6b06840e308d" released by "delete_volume" :: held 1.169s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Created reservations ['e7195c17-3b10-4932-b3d3-d5645ac1f2d1', '1080d8c3-31a2-469f-9cc0-4243aceaade4', '43d48a65-1dc5-4b86-b881-b07b71e2dd26', 'cebb2a29-2692-4869-89e9-b179aecd7109'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:13 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37" returned: 0 in 0.828s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f88172f3-2da8-4289-83dd-4b26680abf10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b7fef-bcb3-4517-9f9b-0ac66d2e464c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:13 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:13 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:13 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10
Jul 23 03:26:13 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:13 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.514s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:13 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:13 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:26:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1df4a1ba-cb17-4068-ae35-aaae16e1176e tempest-VolumesGetTest-1236621928 None] Lock "cinder-7d2afe0e-f662-462d-9d91-6b06840e308d-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:14 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10" returned: 0 in 0.634s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:14 devstack sudo[100220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37
Jul 23 03:26:14 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:14 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37" returned: 0 in 0.626s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:14 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37
Jul 23 03:26:14 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:15 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10.378ad959-313f-41f1-95bf-5c9e4d053a37" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-quobyte-378ad959-313f-41f1-95bf-5c9e4d053a37" released by "_delete_snapshot" :: held 2.634s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-quobyte-f88172f3-2da8-4289-83dd-4b26680abf10" released by "delete_snapshot" :: held 2.684s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Created reservations ['3ace4552-974c-41e9-8e45-1200da2a0e70', '8100c0ba-c0d8-4503-bef6-c594e8d65677', 'a76d5e93-c7f9-4b01-8bc4-f6ec8e0e2b96', 'ad84c018-bd4a-4269-a2eb-2659119dc74a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Delete snapshot completed successfully.
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f2612b21-684d-4f6a-be99-a0611569df11 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-378ad959-313f-41f1-95bf-5c9e4d053a37-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (e31e1716-7167-4702-adf7-f6e0f43d4872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13236af9-e9c5-4257-b096-5a5ec11fd5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13236af9-e9c5-4257-b096-5a5ec11fd5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1776745107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d28aaa6-2694-4c52-9f55-c2b4d86d92e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:15Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d9bad4-8b38-4fc3-87a1-f2c0e586086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d9bad4-8b38-4fc3-87a1-f2c0e586086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887489e9-ac6b-4a1b-8f17-2cc999d850b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "cinder-f88172f3-2da8-4289-83dd-4b26680abf10-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-f88172f3-2da8-4289-83dd-4b26680abf10-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "cinder-quobyte-f88172f3-2da8-4289-83dd-4b26680abf10" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887489e9-ac6b-4a1b-8f17-2cc999d850b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d28aaa6-2694-4c52-9f55-c2b4d86d92e9', 'volume_name': 'volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f7d8aa0>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e903af8d-108a-48bc-8e14-a1faedad0d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e903af8d-108a-48bc-8e14-a1faedad0d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f556d-d86d-4ab2-ad6d-0e024eceb13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Volume 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f7d8aa0>}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Trying to clone 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-quobyte-f88172f3-2da8-4289-83dd-4b26680abf10" acquired by "delete_volume" :: waited 0.042s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eddfc0-f07e-41a7-9dbb-eeef42ebe2fe]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:16 devstack sudo[100229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10
Jul 23 03:26:16 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:26:16 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Image download 20.69 MB at 20.69 MB/s
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd8b3b-6199-4b0e-a114-166b05a4edc1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:16 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD
Jul 23 03:26:16 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:16 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10" returned: 0 in 0.663s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:16 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10
Jul 23 03:26:16 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:17 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d is fetched for user 7eb8498a50894dee97b3135df28509fb. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3c6f9-73fc-47ba-b361-8c06691a8f3b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:17 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f88172f3-2da8-4289-83dd-4b26680abf10" returned: 0 in 0.394s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-quobyte-f88172f3-2da8-4289-83dd-4b26680abf10" released by "delete_volume" :: held 1.166s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:17 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD
Jul 23 03:26:17 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Created reservations ['e5eaae18-0e5e-48a2-a24a-5d1bf2bfd507', '9c633b24-5325-488a-b6ce-7ab18195ea83', 'c24da075-a1bc-45b1-a0f5-f5a1d507929b', '374196ec-1a24-4977-8309-e95c458e93ad'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:17 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:17 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:17 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1776745107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d28aaa6-2694-4c52-9f55-c2b4d86d92e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:15Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Creating volume 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:17 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:17 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 1073741824
Jul 23 03:26:17 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:17 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.420s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Deleted volume successfully.
Jul 23 03:26:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-05c2822d-2095-4a56-a5b1-3e3a0f9ef445 tempest-SnapshotMetadataTestJSON-1632890339 None] Lock "cinder-f88172f3-2da8-4289-83dd-4b26680abf10-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:18 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 1073741824" returned: 0 in 0.742s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:18 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9
Jul 23 03:26:18 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:18 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Attempting download of d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b22b2-7e4e-4ee0-b19b-7b39bc5dafc2]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:19 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5
Jul 23 03:26:19 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:19 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5" returned: 0 in 0.415s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:19 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5
Jul 23 03:26:19 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:19 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5" returned: 1 in 0.360s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_w01h6ao5' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:26:19 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[306819ff-15b3-479a-9033-b18e5e5a2cd2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:19 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD
Jul 23 03:26:19 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:20 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:20 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] d528e14a-f1e8-46f0-b9e4-aded7536eb2d was qcow2, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:26:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:20 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9
Jul 23 03:26:20 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Flow 'volume_create_manager' (4863b7f7-bf4d-423b-b04c-6228e5b3f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1665e594-672a-4cf6-b1d4-d6fee9bb0fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1665e594-672a-4cf6-b1d4-d6fee9bb0fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1185139668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb0d624-a412-4314-87b7-fca79fdd632d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef00e3fa59d44960b307a27987eca5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:22Z,use_quota=True,user_id='279045d5cd9d45bd89ad7e55468fd9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2565ee3-c5de-423b-8407-b01382ce1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2565ee3-c5de-423b-8407-b01382ce1995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b71811f-6bec-4e5a-b894-8f762a1fae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b71811f-6bec-4e5a-b894-8f762a1fae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb0d624-a412-4314-87b7-fca79fdd632d', 'volume_name': 'volume-2fb0d624-a412-4314-87b7-fca79fdd632d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33ab7a8-79e7-4cdb-91b0-9c330bd542d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33ab7a8-79e7-4cdb-91b0-9c330bd542d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee46a074-4d8e-41bd-8131-c3979f4a0ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:22 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Volume 2fb0d624-a412-4314-87b7-fca79fdd632d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb0d624-a412-4314-87b7-fca79fdd632d', 'volume_size': 1}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1185139668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb0d624-a412-4314-87b7-fca79fdd632d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef00e3fa59d44960b307a27987eca5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:22Z,use_quota=True,user_id='279045d5cd9d45bd89ad7e55468fd9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Creating volume 2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:22 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:22 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d 1073741824
Jul 23 03:26:22 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:22 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" returned: 0 in 2.131s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_omuvfue5devstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:26:22 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Converted 112.00 MB image at 52.53 MB/s
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:22 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 1G
Jul 23 03:26:22 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:22 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 1G" returned: 0 in 0.359s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Downloaded image d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d for user 7eb8498a50894dee97b3135df28509fb is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Marking volume 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Copying metadata from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d to 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Creating volume glance metadata for volume 0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 backed by image d528e14a-f1e8-46f0-b9e4-aded7536eb2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:26:22 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d 1073741824" returned: 0 in 0.494s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f556d-d86d-4ab2-ad6d-0e024eceb13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f7d8aa0>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65944ab8-2b7f-4cf1-a3dc-0cc6e6ec704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:22 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Volume volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 (0d28aaa6-2694-4c52-9f55-c2b4d86d92e9): created successfully
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65944ab8-2b7f-4cf1-a3dc-0cc6e6ec704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (e31e1716-7167-4702-adf7-f6e0f43d4872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5bc1f4bc-92a2-4caa-8b28-2577f0e26d52 tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:26:22 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:22 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:23 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.285s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee46a074-4d8e-41bd-8131-c3979f4a0ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb0d624-a412-4314-87b7-fca79fdd632d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb3a127-13c2-49cf-8b90-18ad44fa7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Volume volume-2fb0d624-a412-4314-87b7-fca79fdd632d (2fb0d624-a412-4314-87b7-fca79fdd632d): created successfully
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb3a127-13c2-49cf-8b90-18ad44fa7d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Flow 'volume_create_manager' (4863b7f7-bf4d-423b-b04c-6228e5b3f0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Flow 'volume_create_manager' (cd32d33f-c1ba-4122-af6e-58400ba76fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286e8a08-e603-4a02-80ce-bcf1290b8740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286e8a08-e603-4a02-80ce-bcf1290b8740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1122637796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4959f669-2c11-4b5c-93a7-03354faf7081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1604022de4a5447e9b18c807ea8eea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:23Z,use_quota=True,user_id='779351eff4de41a481867e026838174c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc4023d9-c1b9-4f88-aee2-ea857073d317),volume_type_id=cc4023d9-c1b9-4f88-aee2-ea857073d317)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858c0c93-e12e-437e-b743-a4501ea5c6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858c0c93-e12e-437e-b743-a4501ea5c6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbfbc71-2931-4315-a2d5-3be801f75ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbfbc71-2931-4315-a2d5-3be801f75ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4959f669-2c11-4b5c-93a7-03354faf7081', 'volume_name': 'volume-4959f669-2c11-4b5c-93a7-03354faf7081', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a12b90-5fef-4c23-bb4e-91ac2e41c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a12b90-5fef-4c23-bb4e-91ac2e41c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb9dedf-492f-4fb6-ace4-933e10dc1288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume 4959f669-2c11-4b5c-93a7-03354faf7081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4959f669-2c11-4b5c-93a7-03354faf7081', 'volume_size': 1}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1122637796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4959f669-2c11-4b5c-93a7-03354faf7081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1604022de4a5447e9b18c807ea8eea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:23Z,use_quota=True,user_id='779351eff4de41a481867e026838174c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc4023d9-c1b9-4f88-aee2-ea857073d317),volume_type_id=cc4023d9-c1b9-4f88-aee2-ea857073d317)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Creating volume 4959f669-2c11-4b5c-93a7-03354faf7081 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:23 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5bdf4f9d-f266-4d2f-84d1-2bfc8c2fb466 tempest-VolumesDeleteCascade-839016849 None] Created volume successfully.
Jul 23 03:26:23 devstack sudo[100324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081 1073741824
Jul 23 03:26:23 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Flow 'volume_create_manager' (72751b19-7b2d-431a-a0fc-6c4fed53cd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bccec1-5f18-4a45-b864-12c5ae08fbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bccec1-5f18-4a45-b864-12c5ae08fbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-867688708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61e2594-724e-4243-90e4-b58d5351f33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1604022de4a5447e9b18c807ea8eea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:24Z,use_quota=True,user_id='779351eff4de41a481867e026838174c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b8d44c4-5023-465d-beb8-ed1cccfbfed6),volume_type_id=9b8d44c4-5023-465d-beb8-ed1cccfbfed6)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed92fa88-3b8e-46c1-a559-937c310e1937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed92fa88-3b8e-46c1-a559-937c310e1937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8a485d-7744-46bd-bb81-a7a7a5724e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8a485d-7744-46bd-bb81-a7a7a5724e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61e2594-724e-4243-90e4-b58d5351f33f', 'volume_name': 'volume-e61e2594-724e-4243-90e4-b58d5351f33f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8db770f-b1de-4638-98eb-203faa43a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8db770f-b1de-4638-98eb-203faa43a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398302f9-edd6-458d-81d9-855c0fb040df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:23 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume e61e2594-724e-4243-90e4-b58d5351f33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61e2594-724e-4243-90e4-b58d5351f33f', 'volume_size': 1}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:23 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081 1073741824" returned: 0 in 0.611s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:23 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081
Jul 23 03:26:23 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (9367cf10-a365-44d4-9cc6-f2b21d8af24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe71a4e7-eef7-4bbc-b62f-36df29e40472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe71a4e7-eef7-4bbc-b62f-36df29e40472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371444144',display_name='tempest-VolumesGetTest-Volume-339463212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fface4c-fca0-43cf-93a0-06cad0136da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:24Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c7d9c9-a7c3-4033-8408-f730701ab278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c7d9c9-a7c3-4033-8408-f730701ab278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99929c9-66a6-4a2d-b557-1107200fd7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99929c9-66a6-4a2d-b557-1107200fd7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fface4c-fca0-43cf-93a0-06cad0136da0', 'volume_name': 'volume-1fface4c-fca0-43cf-93a0-06cad0136da0', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee69fcd9-03b5-4d96-b252-4acd8e9d0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee69fcd9-03b5-4d96-b252-4acd8e9d0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa07ad1e-23f0-4156-837b-2bd59c0b2a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Volume 1fface4c-fca0-43cf-93a0-06cad0136da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fface4c-fca0-43cf-93a0-06cad0136da0', 'volume_size': 1}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:24 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081" returned: 0 in 0.321s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-867688708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61e2594-724e-4243-90e4-b58d5351f33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1604022de4a5447e9b18c807ea8eea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:24Z,use_quota=True,user_id='779351eff4de41a481867e026838174c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b8d44c4-5023-465d-beb8-ed1cccfbfed6),volume_type_id=9b8d44c4-5023-465d-beb8-ed1cccfbfed6)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Creating volume e61e2594-724e-4243-90e4-b58d5351f33f {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:24 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:24 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f 1073741824
Jul 23 03:26:24 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb9dedf-492f-4fb6-ace4-933e10dc1288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4959f669-2c11-4b5c-93a7-03354faf7081', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33cb302-b2e2-480f-9e74-bcdd64cabc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume volume-4959f669-2c11-4b5c-93a7-03354faf7081 (4959f669-2c11-4b5c-93a7-03354faf7081): created successfully
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33cb302-b2e2-480f-9e74-bcdd64cabc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Flow 'volume_create_manager' (cd32d33f-c1ba-4122-af6e-58400ba76fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c032591b-48f4-46e6-a252-6078c6643309 tempest-TestInstancesWithCinderVolumes-1352807198 None] Created volume successfully.
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Flow 'volume_create_manager' (c8c59368-a578-4e46-ae57-b6d84b1e75a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e7e251-1cba-462f-94dd-66ca1ebfc96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e7e251-1cba-462f-94dd-66ca1ebfc96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-230929720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f52a85-24ac-4768-ac43-c08264d046c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1604022de4a5447e9b18c807ea8eea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:24Z,use_quota=True,user_id='779351eff4de41a481867e026838174c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd4fba88-5c5b-4948-b62f-0563e10621d3),volume_type_id=cd4fba88-5c5b-4948-b62f-0563e10621d3)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d417dcf-ad72-49a0-b4a6-44a816ae6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d417dcf-ad72-49a0-b4a6-44a816ae6702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396a4eec-bfd3-442e-884d-3770b72ab757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:24 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f 1073741824" returned: 0 in 0.564s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:24 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f
Jul 23 03:26:24 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (396a4eec-bfd3-442e-884d-3770b72ab757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8f52a85-24ac-4768-ac43-c08264d046c4', 'volume_name': 'volume-c8f52a85-24ac-4768-ac43-c08264d046c4', 'volume_size': 1, 'image_id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43a3d9f5-7a28-4845-88c1-822b26b865c6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1698362426', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1604022de4a5447e9b18c807ea8eea16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'created_at': datetime.datetime(2026, 7, 23, 1, 26, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 26, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43a3d9f5-7a28-4845-88c1-822b26b865c6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736934f31c10>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bfdaa7-6f03-4d28-bbef-3e953d1a91b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bfdaa7-6f03-4d28-bbef-3e953d1a91b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61289ad-96a0-472e-97e5-cf21e16e35f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:24 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume c8f52a85-24ac-4768-ac43-c08264d046c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8f52a85-24ac-4768-ac43-c08264d046c4', 'volume_size': 1, 'image_id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43a3d9f5-7a28-4845-88c1-822b26b865c6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1698362426', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1604022de4a5447e9b18c807ea8eea16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'created_at': datetime.datetime(2026, 7, 23, 1, 26, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 26, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43a3d9f5-7a28-4845-88c1-822b26b865c6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736934f31c10>}
Jul 23 03:26:24 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Trying to clone c8f52a85-24ac-4768-ac43-c08264d046c4 from image 43a3d9f5-7a28-4845-88c1-822b26b865c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43a3d9f5-7a28-4845-88c1-822b26b865c6', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:26:25 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f" returned: 0 in 0.264s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371444144',display_name='tempest-VolumesGetTest-Volume-339463212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fface4c-fca0-43cf-93a0-06cad0136da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='460996493ff24fc593bb1ca01aa49cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:24Z,use_quota=True,user_id='7eb8498a50894dee97b3135df28509fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Creating volume 1fface4c-fca0-43cf-93a0-06cad0136da0 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:25 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398302f9-edd6-458d-81d9-855c0fb040df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61e2594-724e-4243-90e4-b58d5351f33f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39025b7-4b05-46c0-87a9-c40ee36b358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:25 devstack sudo[100343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0 1073741824
Jul 23 03:26:25 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume volume-e61e2594-724e-4243-90e4-b58d5351f33f (e61e2594-724e-4243-90e4-b58d5351f33f): created successfully
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39025b7-4b05-46c0-87a9-c40ee36b358a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Flow 'volume_create_manager' (72751b19-7b2d-431a-a0fc-6c4fed53cd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4ceecd00-857e-4875-b633-9ee4a2dba91f tempest-TestInstancesWithCinderVolumes-1352807198 None] Created volume successfully.
Jul 23 03:26:25 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0 1073741824" returned: 0 in 0.507s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:25 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0
Jul 23 03:26:25 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:25 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0" returned: 0 in 0.271s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.376s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa07ad1e-23f0-4156-837b-2bd59c0b2a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fface4c-fca0-43cf-93a0-06cad0136da0', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d7ddf-b392-4636-99a7-bed0fecc0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Creating offline snapshot 02824de0-b7e1-4a73-85db-65d54c4f7de7 of volume 2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:26:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Volume volume-1fface4c-fca0-43cf-93a0-06cad0136da0 (1fface4c-fca0-43cf-93a0-06cad0136da0): created successfully
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d7ddf-b392-4636-99a7-bed0fecc0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Flow 'volume_create_manager' (9367cf10-a365-44d4-9cc6-f2b21d8af24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03322d9-2519-40a3-b1c0-7bfb533d0ad2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-25483521-6d7f-4543-b571-e3c1407e6a28 tempest-VolumesGetTest-1236621928 None] Created volume successfully.
Jul 23 03:26:26 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:26 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-1fface4c-fca0-43cf-93a0-06cad0136da0-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Lock "cinder-1fface4c-fca0-43cf-93a0-06cad0136da0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-1fface4c-fca0-43cf-93a0-06cad0136da0" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-1fface4c-fca0-43cf-93a0-06cad0136da0" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:26 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.559s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe70adf-062c-442a-8dae-88bf0bdb980a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:26 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 1G
Jul 23 03:26:26 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:26 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0
Jul 23 03:26:26 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:27 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0" returned: 0 in 0.434s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:27 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 1G" returned: 0 in 0.467s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:27 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0
Jul 23 03:26:27 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:27 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:27 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:27 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1fface4c-fca0-43cf-93a0-06cad0136da0" returned: 0 in 0.273s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-1fface4c-fca0-43cf-93a0-06cad0136da0" released by "delete_volume" :: held 0.786s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Created reservations ['d05d9cd7-66c0-48cf-843e-b0e577b285c5', 'ca57e66b-c05d-4c42-b7e1-d9322ca1f4e1', '2f454a3e-4bc2-4405-bbe7-90055206a71b', '6a7038da-a94d-432c-b42c-ef9b4da5a629'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:27 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.382s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:27 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 is being set with open permissions: ugo+rw
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:27 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:27 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:27 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:27 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Lock "cinder-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Acquiring lock "cinder-quobyte-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:27 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.447s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9201667-30c4-4a3e-8add-04680fedc3e8]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:27 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:27 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:26:28 devstack sudo[100384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info
Jul 23 03:26:28 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4884a915-88b4-4fe3-82f2-f3adc7b8610d tempest-VolumesGetTest-1236621928 None] Lock "cinder-1fface4c-fca0-43cf-93a0-06cad0136da0-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:28 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9
Jul 23 03:26:28 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:28 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:28 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info is being set with open permissions: ugo+rw
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:28 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info
Jul 23 03:26:28 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:28 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" returned: 0 in 0.446s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:28 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9
Jul 23 03:26:28 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:28 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.info" returned: 0 in 0.248s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f2bfb64f-aa4b-40bd-a3ab-706f2442ee00 tempest-VolumesDeleteCascade-839016849 None] Create snapshot completed successfully
Jul 23 03:26:28 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" returned: 0 in 0.299s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Lock "cinder-quobyte-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9" released by "delete_volume" :: held 0.791s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Created reservations ['65174eba-23d0-4a1e-8bc9-28d72a12c41c', '7243083a-e338-4fd0-82a1-76a7f993ff0e', '97499022-976c-4dde-97fd-9635af636e36', 'a8c32d06-4efc-4c72-9a7a-5f1c97d8ebb9'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:28 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:28 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:29 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.350s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:29 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Deleted volume successfully.
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-11a0911c-2b9c-4658-a011-025e052af9f8 tempest-VolumesGetTest-1236621928 None] Lock "cinder-0d28aaa6-2694-4c52-9f55-c2b4d86d92e9-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Creating offline snapshot 45c1918f-78da-4af4-8842-efd8dcae72e1 of volume 2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad94fb-c7c2-4ec7-9682-927d3d7a56bc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:29 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:29 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD, size 20.69 MB, duration 4.81 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:26:29 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Image download 20.69 MB at 4.30 MB/s
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4492bac4-8f88-4888-aeea-d618485f2317]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:29 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.493s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb0d624-a412-4314-87b7-fca79fdd632d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:29 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 1G
Jul 23 03:26:29 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:29 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD
Jul 23 03:26:29 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:30 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Temporary image 43a3d9f5-7a28-4845-88c1-822b26b865c6 is fetched for user 779351eff4de41a481867e026838174c. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca8f86-9bfe-4226-b171-306b86c7eb73]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:30 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD
Jul 23 03:26:30 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:30 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 1G" returned: 0 in 0.642s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:30 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1
Jul 23 03:26:30 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:30 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:30 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1" returned: 0 in 0.453s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:31 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 is being set with open permissions: ugo+rw
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-ef922ce9-87fe-4a64-9fc6-0387ced17e08 req-4f5576bf-e969-4f60-9637-bc98cad3612c tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:31 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1
Jul 23 03:26:31 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:31 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1" returned: 0 in 0.256s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-230929720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f52a85-24ac-4768-ac43-c08264d046c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1604022de4a5447e9b18c807ea8eea16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:24Z,use_quota=True,user_id='779351eff4de41a481867e026838174c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd4fba88-5c5b-4948-b62f-0563e10621d3),volume_type_id=cd4fba88-5c5b-4948-b62f-0563e10621d3)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Creating volume c8f52a85-24ac-4768-ac43-c08264d046c4 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:31 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:31 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 1073741824
Jul 23 03:26:31 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-615899a1-7d40-4045-a953-a87bbd3e14d6 tempest-VolumesDeleteCascade-839016849 None] Create snapshot completed successfully
Jul 23 03:26:31 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 1073741824" returned: 0 in 0.507s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:31 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4
Jul 23 03:26:31 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:32 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4" returned: 0 in 0.251s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-ef922ce9-87fe-4a64-9fc6-0387ced17e08 req-4f5576bf-e969-4f60-9637-bc98cad3612c tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.079s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-ef922ce9-87fe-4a64-9fc6-0387ced17e08 req-4f5576bf-e969-4f60-9637-bc98cad3612c tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Attempting download of 43a3d9f5-7a28-4845-88c1-822b26b865c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/43a3d9f5-7a28-4845-88c1-822b26b865c6', 'metadata': {}}])) to volume c8f52a85-24ac-4768-ac43-c08264d046c4. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-ef922ce9-87fe-4a64-9fc6-0387ced17e08 req-4f5576bf-e969-4f60-9637-bc98cad3612c tempest-TestServerVolumeAttachmentScenario-2060676250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fb8ff72-89bd-44c7-b6ba-c9c9a9405c68', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[137a38e5-1cf5-4b26-94ea-53476ad6bf4d]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_ {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-ef922ce9-87fe-4a64-9fc6-0387ced17e08 req-4f5576bf-e969-4f60-9637-bc98cad3612c tempest-TestServerVolumeAttachmentScenario-2060676250 None] attachment_update completed successfully.
Jul 23 03:26:32 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_
Jul 23 03:26:32 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-2fb0d624-a412-4314-87b7-fca79fdd632d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-2fb0d624-a412-4314-87b7-fca79fdd632d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Performing cascade delete. {{(pid=88344) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-02824de0-b7e1-4a73-85db-65d54c4f7de7-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-02824de0-b7e1-4a73-85db-65d54c4f7de7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:32 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_" returned: 0 in 0.503s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_ {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-02824de0-b7e1-4a73-85db-65d54c4f7de7" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-02824de0-b7e1-4a73-85db-65d54c4f7de7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Deleting offline snapshot 02824de0-b7e1-4a73-85db-65d54c4f7de7 of volume 2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] snapshot_file for this snap is: volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8204b26-232d-49c7-8b9c-4d8808c798e0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:32 devstack sudo[100869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_
Jul 23 03:26:32 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Flow 'volume_create_manager' (95aa19bc-e5d3-49ac-9e15-a6274c3f1538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:33 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:33 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1f734b-cd98-4f29-8d65-52710bc1f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1f734b-cd98-4f29-8d65-52710bc1f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1907045558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c235c8-078b-4114-86e0-46380d33100c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a089c5941424e95b0cdb41de3b55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:33Z,use_quota=True,user_id='f5a2de1beb7740db81c15b3fa32e78c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551f6f98-f417-47a9-912c-2744593b8e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551f6f98-f417-47a9-912c-2744593b8e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f7759-db7a-4b88-9b8d-b5607f306f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f7759-db7a-4b88-9b8d-b5607f306f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c235c8-078b-4114-86e0-46380d33100c', 'volume_name': 'volume-b9c235c8-078b-4114-86e0-46380d33100c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a3ba84-7e22-4012-9f38-e81dd755ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a3ba84-7e22-4012-9f38-e81dd755ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9db332-b3fc-4fe1-b537-a41e52807e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Volume b9c235c8-078b-4114-86e0-46380d33100c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c235c8-078b-4114-86e0-46380d33100c', 'volume_size': 1}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1907045558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c235c8-078b-4114-86e0-46380d33100c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a089c5941424e95b0cdb41de3b55f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:33Z,use_quota=True,user_id='f5a2de1beb7740db81c15b3fa32e78c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Creating volume b9c235c8-078b-4114-86e0-46380d33100c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:33 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:33 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c 1073741824
Jul 23 03:26:33 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_" returned: 1 in 0.468s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43a3d9f5-7a28-4845-88c1-822b26b865c6_5og6gn1_' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b2066-814f-41b4-9eae-52aca58b6298]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:33 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD
Jul 23 03:26:33 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.603s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb0d624-a412-4314-87b7-fca79fdd632d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5839968-a3d7-4133-978f-0bc4e226af0c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:33 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:33 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] 43a3d9f5-7a28-4845-88c1-822b26b865c6 was qcow2, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:33 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4
Jul 23 03:26:33 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c 1073741824" returned: 0 in 0.668s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:33 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c
Jul 23 03:26:33 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:33 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.481s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e588dc7-036e-4e94-91e5-c62aa8e496db]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:34 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1
Jul 23 03:26:34 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:34 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9db332-b3fc-4fe1-b537-a41e52807e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c235c8-078b-4114-86e0-46380d33100c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82075c8f-e6ed-446a-8d81-ef8d075aa03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:34 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Volume volume-b9c235c8-078b-4114-86e0-46380d33100c (b9c235c8-078b-4114-86e0-46380d33100c): created successfully
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82075c8f-e6ed-446a-8d81-ef8d075aa03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Flow 'volume_create_manager' (95aa19bc-e5d3-49ac-9e15-a6274c3f1538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6c538fb2-2433-4b39-a9ef-ad356386dee6 tempest-VolumesNegativeTest-1733075223 None] Created volume successfully.
Jul 23 03:26:34 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb0d624-a412-4314-87b7-fca79fdd632d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee71b0d4-fe75-4003-9318-df939949326f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:34 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:34 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:34 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.429s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb0d624-a412-4314-87b7-fca79fdd632d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb7019-adc3-42aa-a9f3-7c4fa888e078]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:35 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:35 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:35 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.433s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:35 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:35 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:35 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4" returned: 0 in 2.117s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43a3d9f5-7a28-4845-88c1-822b26b865c6_2mtr0di6devstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:26:35 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Converted 112.00 MB image at 52.87 MB/s
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:35 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 1G
Jul 23 03:26:35 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:35 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.517s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:35 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7
Jul 23 03:26:35 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:36 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.02824de0-b7e1-4a73-85db-65d54c4f7de7" returned: 0 in 0.366s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 -F qcow2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:36 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 1G" returned: 0 in 0.451s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Downloaded image 43a3d9f5-7a28-4845-88c1-822b26b865c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/43a3d9f5-7a28-4845-88c1-822b26b865c6', 'metadata': {}}])) to volume c8f52a85-24ac-4768-ac43-c08264d046c4 successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:26:36 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 -F qcow2
Jul 23 03:26:36 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Temporary image 43a3d9f5-7a28-4845-88c1-822b26b865c6 for user 779351eff4de41a481867e026838174c is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Marking volume c8f52a85-24ac-4768-ac43-c08264d046c4 as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Copying metadata from image 43a3d9f5-7a28-4845-88c1-822b26b865c6 to c8f52a85-24ac-4768-ac43-c08264d046c4. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Creating volume glance metadata for volume c8f52a85-24ac-4768-ac43-c08264d046c4 backed by image 43a3d9f5-7a28-4845-88c1-822b26b865c6 with: {'image_id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'image_name': 'tempest-scenario-img--1698362426', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:26:36 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb0d624-a412-4314-87b7-fca79fdd632d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 -F qcow2" returned: 0 in 0.353s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61289ad-96a0-472e-97e5-cf21e16e35f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f52a85-24ac-4768-ac43-c08264d046c4', 'volume_size': 1, 'image_id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43a3d9f5-7a28-4845-88c1-822b26b865c6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1698362426', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1604022de4a5447e9b18c807ea8eea16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43a3d9f5-7a28-4845-88c1-822b26b865c6', 'created_at': datetime.datetime(2026, 7, 23, 1, 26, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 26, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43a3d9f5-7a28-4845-88c1-822b26b865c6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736934f31c10>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c20a35-b47e-4926-8932-d0aecb2514ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-02824de0-b7e1-4a73-85db-65d54c4f7de7" released by "_delete_snapshot" :: held 3.884s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" released by "delete_snapshot" :: held 3.937s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Volume volume-c8f52a85-24ac-4768-ac43-c08264d046c4 (c8f52a85-24ac-4768-ac43-c08264d046c4): created successfully
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c20a35-b47e-4926-8932-d0aecb2514ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Flow 'volume_create_manager' (c8c59368-a578-4e46-ae57-b6d84b1e75a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2bf30a02-1638-4500-ac36-90f73284298a tempest-TestInstancesWithCinderVolumes-1352807198 None] Created volume successfully.
Jul 23 03:26:36 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Created reservations ['6e5748ab-a1de-40bf-acbc-d25c7c48ee03', '6f830d6b-316c-4c1e-9f19-87821fe567b9', '5b9efee5-f2e6-411b-812f-f03190af041c', '91e8c172-ae58-42b9-98fe-7f87c23e77a3'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Delete snapshot completed successfully.
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-02824de0-b7e1-4a73-85db-65d54c4f7de7-delete_snapshot" released by "delete_snapshot" :: held 4.361s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-45c1918f-78da-4af4-8842-efd8dcae72e1-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-45c1918f-78da-4af4-8842-efd8dcae72e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-45c1918f-78da-4af4-8842-efd8dcae72e1" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-45c1918f-78da-4af4-8842-efd8dcae72e1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Deleting offline snapshot 45c1918f-78da-4af4-8842-efd8dcae72e1 of volume 2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] snapshot_file for this snap is: volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0925f7-5a54-45b4-b02e-de10add2f148]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:37 devstack sudo[100955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1
Jul 23 03:26:37 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:37 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1" returned: 0 in 0.502s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb0d624-a412-4314-87b7-fca79fdd632d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[92999baf-f9ac-4e3e-bf0e-33ac343be1c0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:37 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:37 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:38 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.674s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:38 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1
Jul 23 03:26:38 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-030548ca-3e14-4acf-b19d-7bf083fc05da req-b8f424aa-8b24-4b9f-add1-64ea644d1e95 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-030548ca-3e14-4acf-b19d-7bf083fc05da req-b8f424aa-8b24-4b9f-add1-64ea644d1e95 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-030548ca-3e14-4acf-b19d-7bf083fc05da req-b8f424aa-8b24-4b9f-add1-64ea644d1e95 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-030548ca-3e14-4acf-b19d-7bf083fc05da req-b8f424aa-8b24-4b9f-add1-64ea644d1e95 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '295e3464-0e5d-433c-b88d-da170a42aeca', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:26:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-030548ca-3e14-4acf-b19d-7bf083fc05da req-b8f424aa-8b24-4b9f-add1-64ea644d1e95 tempest-TestServerVolumeAttachmentScenario-2060676250 None] attachment_update completed successfully.
Jul 23 03:26:38 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1" returned: 0 in 0.587s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:39 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1
Jul 23 03:26:39 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:39 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d.45c1918f-78da-4af4-8842-efd8dcae72e1" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-45c1918f-78da-4af4-8842-efd8dcae72e1" released by "_delete_snapshot" :: held 2.344s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" released by "delete_snapshot" :: held 2.379s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Created reservations ['b34e5fbf-5e89-41ed-aba2-7ae7a0f51e05', 'e44557b1-de2f-455f-ac6d-2cd68d4e8f79', '49e8f042-2e7a-4009-8264-d98f15d00e31', 'b3feeca2-ff0f-4349-97f1-ae08f0315216'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Delete snapshot completed successfully.
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-45c1918f-78da-4af4-8842-efd8dcae72e1-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Snapshots deleted, issuing volume delete {{(pid=88344) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" acquired by "delete_volume" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8c0ea-8cfe-4130-9983-e3e734445b4b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:40 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:40 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:40 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.501s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:40 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d
Jul 23 03:26:40 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:40 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2fb0d624-a412-4314-87b7-fca79fdd632d" returned: 0 in 0.351s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-2fb0d624-a412-4314-87b7-fca79fdd632d" released by "delete_volume" :: held 0.972s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:40 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Created reservations ['06500307-65ec-4459-bdce-1effa3cdddcc', '5320c652-2ebb-4519-b480-9be37365a940', '441ba0a6-7680-47cb-acca-941e96f09682', '10a07e56-e994-41cd-a3c2-da32dd19f5e8'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:41 devstack sudo[101029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:41 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-7f5f884c-05ef-4554-9a9f-6be93a6bfb66 req-bcd63aa9-9bf0-47c3-acb5-0343c7270b8b tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-7f5f884c-05ef-4554-9a9f-6be93a6bfb66 req-bcd63aa9-9bf0-47c3-acb5-0343c7270b8b tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-7f5f884c-05ef-4554-9a9f-6be93a6bfb66 req-bcd63aa9-9bf0-47c3-acb5-0343c7270b8b tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-7f5f884c-05ef-4554-9a9f-6be93a6bfb66 req-bcd63aa9-9bf0-47c3-acb5-0343c7270b8b tempest-TestInstancesWithCinderVolumes-1352807198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-c8f52a85-24ac-4768-ac43-c08264d046c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '619782e0-d637-4993-a0da-3fa8cbe301ae', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:26:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-7f5f884c-05ef-4554-9a9f-6be93a6bfb66 req-bcd63aa9-9bf0-47c3-acb5-0343c7270b8b tempest-TestInstancesWithCinderVolumes-1352807198 None] attachment_update completed successfully.
Jul 23 03:26:41 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:26:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Deleted volume successfully.
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60bceaac-5bcb-4283-8198-3bfd5038f753 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-2fb0d624-a412-4314-87b7-fca79fdd632d-delete_volume" released by "delete_volume" :: held 8.864s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-7090b695-2df3-4db1-95ca-f70f12a35465 req-56e580db-7648-4e02-a17b-2ee85cdcfa97 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Terminate volume connection completed successfully.
Jul 23 03:26:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-7090b695-2df3-4db1-95ca-f70f12a35465 req-56e580db-7648-4e02-a17b-2ee85cdcfa97 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Deleting attachment 295e3464-0e5d-433c-b88d-da170a42aeca. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Flow 'volume_create_manager' (dd0423d2-a19d-437a-893c-26a5900f5502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cf6c2e-4050-4da2-94d6-510f183fb4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cf6c2e-4050-4da2-94d6-510f183fb4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-345461364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1516a928-378e-4e92-97cf-103964c66ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef00e3fa59d44960b307a27987eca5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:43Z,use_quota=True,user_id='279045d5cd9d45bd89ad7e55468fd9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c2d91f-c183-4447-8e14-9e9a7357cbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c2d91f-c183-4447-8e14-9e9a7357cbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b905019-dbcd-43f7-9a8d-1369241721d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b905019-dbcd-43f7-9a8d-1369241721d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1516a928-378e-4e92-97cf-103964c66ff2', 'volume_name': 'volume-1516a928-378e-4e92-97cf-103964c66ff2', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e93980-2c46-4632-bc1d-26290c7e7a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e93980-2c46-4632-bc1d-26290c7e7a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc09d94-e38e-4227-96c4-bc64e4aed213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Volume 1516a928-378e-4e92-97cf-103964c66ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1516a928-378e-4e92-97cf-103964c66ff2', 'volume_size': 1}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-345461364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1516a928-378e-4e92-97cf-103964c66ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef00e3fa59d44960b307a27987eca5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:43Z,use_quota=True,user_id='279045d5cd9d45bd89ad7e55468fd9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Creating volume 1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:42 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:26:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:43 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 1073741824
Jul 23 03:26:43 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:43 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 1073741824" returned: 0 in 0.975s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:44 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:26:44 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-3bf48437-4ead-43bf-b353-51cf70408cb3 req-ee73abee-c8b6-4545-be78-4a0249067cce tempest-TestServerVolumeAttachmentScenario-2060676250 None] Terminate volume connection completed successfully.
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-3bf48437-4ead-43bf-b353-51cf70408cb3 req-ee73abee-c8b6-4545-be78-4a0249067cce tempest-TestServerVolumeAttachmentScenario-2060676250 None] Deleting attachment 4fb8ff72-89bd-44c7-b6ba-c9c9a9405c68. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:26:44 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.577s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc09d94-e38e-4227-96c4-bc64e4aed213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1516a928-378e-4e92-97cf-103964c66ff2', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0a69d3-22a5-494e-a0cc-c2ce1a927d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:44 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Volume volume-1516a928-378e-4e92-97cf-103964c66ff2 (1516a928-378e-4e92-97cf-103964c66ff2): created successfully
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0a69d3-22a5-494e-a0cc-c2ce1a927d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Flow 'volume_create_manager' (dd0423d2-a19d-437a-893c-26a5900f5502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d912281a-3843-4e71-8702-407062bce52a tempest-VolumesDeleteCascade-839016849 None] Created volume successfully.
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Creating offline snapshot 64755f2c-b265-44ff-bce2-538662720e4e of volume 1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[71510843-8273-48ef-810d-677f26d2bf9b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:45 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:26:45 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.549s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:45 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:45 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e 1G
Jul 23 03:26:45 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:47 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e 1G" returned: 0 in 1.377s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1516a928-378e-4e92-97cf-103964c66ff2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:47 devstack sudo[101590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1516a928-378e-4e92-97cf-103964c66ff2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e
Jul 23 03:26:47 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:47 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1516a928-378e-4e92-97cf-103964c66ff2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e" returned: 0 in 0.881s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:47 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e is being set with open permissions: ugo+rw
Jul 23 03:26:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:47 devstack sudo[101613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e
Jul 23 03:26:48 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:48 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e" returned: 0 in 0.422s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:48 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info
Jul 23 03:26:48 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:49 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info" returned: 0 in 0.671s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:49 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info is being set with open permissions: ugo+rw
Jul 23 03:26:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:49 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info
Jul 23 03:26:49 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:49 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.info" returned: 0 in 0.433s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.531s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:49 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-07b6ee89-bd7f-47e7-b185-1fde23525c44 tempest-VolumesDeleteCascade-839016849 None] Create snapshot completed successfully
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Flow 'volume_create_manager' (3d33e401-2723-495f-b2da-a9149d0f0992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcd2872-5e7a-4530-966b-92befe0c2a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcd2872-5e7a-4530-966b-92befe0c2a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1052856328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6626d533-8267-4039-877e-830939c367a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef00e3fa59d44960b307a27987eca5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64755f2c-b265-44ff-bce2-538662720e4e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:52Z,use_quota=True,user_id='279045d5cd9d45bd89ad7e55468fd9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2f39b9-ab99-49a5-aac5-206956414885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2f39b9-ab99-49a5-aac5-206956414885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b3b4d0-e6f1-4557-924e-7da68d3c49df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b3b4d0-e6f1-4557-924e-7da68d3c49df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6626d533-8267-4039-877e-830939c367a8', 'volume_name': 'volume-6626d533-8267-4039-877e-830939c367a8', 'volume_size': 1, 'snapshot_id': '64755f2c-b265-44ff-bce2-538662720e4e'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e8b270-70ad-44e7-9efc-d0b5d572022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e8b270-70ad-44e7-9efc-d0b5d572022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38421453-2065-46b8-bac0-190d2cf11bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:26:52 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Volume 6626d533-8267-4039-877e-830939c367a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6626d533-8267-4039-877e-830939c367a8', 'volume_size': 1, 'snapshot_id': '64755f2c-b265-44ff-bce2-538662720e4e'}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-64755f2c-b265-44ff-bce2-538662720e4e-6626d533-8267-4039-877e-830939c367a8" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-64755f2c-b265-44ff-bce2-538662720e4e-6626d533-8267-4039-877e-830939c367a8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Creating volume 6626d533-8267-4039-877e-830939c367a8 from snapshot 64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-6626d533-8267-4039-877e-830939c367a8" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-6626d533-8267-4039-877e-830939c367a8" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] snapshot: 64755f2c-b265-44ff-bce2-538662720e4e, volume: 6626d533-8267-4039-877e-830939c367a8,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2784a96-bfb4-42f6-9c34-963fc5f286c8]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:52 devstack sudo[101693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e
Jul 23 03:26:52 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:53 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e" returned: 0 in 0.639s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1516a928-378e-4e92-97cf-103964c66ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5083aab9-e4aa-4535-9322-82baaabd4ccb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:53 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:26:53 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:53 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.547s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:26:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:53 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8
Jul 23 03:26:53 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "cinder-80f5b5fc-dec6-4b80-b555-4e7b8668fdac-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-80f5b5fc-dec6-4b80-b555-4e7b8668fdac-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "cinder-quobyte-80f5b5fc-dec6-4b80-b555-4e7b8668fdac" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:26:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-quobyte-80f5b5fc-dec6-4b80-b555-4e7b8668fdac" acquired by "delete_volume" :: waited 0.051s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:26:56 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7580e7c8-1e1e-42e8-bd5c-588c97e4c328]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:26:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:56 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac
Jul 23 03:26:56 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:58 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac" returned: 0 in 1.736s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:58 devstack sudo[101727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac
Jul 23 03:26:58 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:58 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-80f5b5fc-dec6-4b80-b555-4e7b8668fdac" returned: 0 in 0.746s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:58 devstack sudo[101730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:58 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-quobyte-80f5b5fc-dec6-4b80-b555-4e7b8668fdac" released by "delete_volume" :: held 2.616s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Created reservations ['a9432ea9-7843-426d-b476-85e82d3a34a3', '18d81608-1ee9-465b-ba84-40e4417c8ceb', 'f9c48206-7782-47ad-af3a-cd8850c28979', '318c4617-ab6a-424b-9295-a28220605f10'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:26:59 devstack sudo[101732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:26:59 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:26:59 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 1.128s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:26:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "cinder-1e00d1bf-dbbc-485a-948f-68b43bd9f937-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-1e00d1bf-dbbc-485a-948f-68b43bd9f937-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "cinder-quobyte-1e00d1bf-dbbc-485a-948f-68b43bd9f937" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-quobyte-1e00d1bf-dbbc-485a-948f-68b43bd9f937" acquired by "delete_volume" :: waited 0.050s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:00 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 1.120s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Deleted volume successfully.
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ac01f-2aaf-484e-ac5a-f9c6347cbcc5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0e3334ee-2dd9-4683-b951-76d5f55a2fc5 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-80f5b5fc-dec6-4b80-b555-4e7b8668fdac-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:00 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8" returned: 0 in 7.145s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e548fa2b-a712-4e81-b574-effedfb00235]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:00 devstack sudo[101736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937
Jul 23 03:27:00 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:01 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:27:01 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:01 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937" returned: 0 in 0.734s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:01 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937
Jul 23 03:27:01 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:01 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.867s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:01 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:27:01 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Converted 1024.00 MB image at 143.29 MB/s
Jul 23 03:27:01 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 is being set with open permissions: ugo+rw
Jul 23 03:27:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:01 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8
Jul 23 03:27:01 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:01 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1e00d1bf-dbbc-485a-948f-68b43bd9f937" returned: 0 in 0.493s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-quobyte-1e00d1bf-dbbc-485a-948f-68b43bd9f937" released by "delete_volume" :: held 1.345s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:02 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8" returned: 0 in 0.375s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-6626d533-8267-4039-877e-830939c367a8" released by "_copy_volume_from_snapshot" :: held 9.740s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Created reservations ['6f04bdb4-a3b0-4795-b313-a59624374f33', 'f0fcc7de-c9eb-4f0f-835d-19dc54cc1846', '85995e8e-bcf8-47e2-a103-9d9ae9f8223e', 'fac8f447-7731-4951-b205-1547c9c8e360'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-64755f2c-b265-44ff-bce2-538662720e4e-6626d533-8267-4039-877e-830939c367a8" released by "_create_volume_from_snapshot" :: held 9.805s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.831s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38421453-2065-46b8-bac0-190d2cf11bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6626d533-8267-4039-877e-830939c367a8', 'volume_size': 1, 'snapshot_id': '64755f2c-b265-44ff-bce2-538662720e4e'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f02d57-f0bd-468f-a8c3-95e7cd4786c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:02 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Volume volume-6626d533-8267-4039-877e-830939c367a8 (6626d533-8267-4039-877e-830939c367a8): created successfully
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f02d57-f0bd-468f-a8c3-95e7cd4786c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Flow 'volume_create_manager' (3d33e401-2723-495f-b2da-a9149d0f0992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-819dbb6e-14eb-4684-bf90-c9dc622a271c tempest-VolumesDeleteCascade-839016849 None] Created volume successfully.
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:02 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:02 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:02 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.314s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Deleted volume successfully.
Jul 23 03:27:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9afae860-81f1-492a-9f7c-207f30ba3a48 tempest-TestServerVolumeAttachmentScenario-2060676250 None] Lock "cinder-1e00d1bf-dbbc-485a-948f-68b43bd9f937-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-1516a928-378e-4e92-97cf-103964c66ff2-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-1516a928-378e-4e92-97cf-103964c66ff2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Performing cascade delete. {{(pid=88344) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-64755f2c-b265-44ff-bce2-538662720e4e-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-64755f2c-b265-44ff-bce2-538662720e4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-1516a928-378e-4e92-97cf-103964c66ff2" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-1516a928-378e-4e92-97cf-103964c66ff2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-64755f2c-b265-44ff-bce2-538662720e4e" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-64755f2c-b265-44ff-bce2-538662720e4e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Deleting offline snapshot 64755f2c-b265-44ff-bce2-538662720e4e of volume 1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] snapshot_file for this snap is: volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6d8b9-e205-4a70-bba6-b55cdb41f25e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:04 devstack sudo[101759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e
Jul 23 03:27:04 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:04 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e" returned: 0 in 0.465s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1516a928-378e-4e92-97cf-103964c66ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:27:04 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe59057-1140-4906-b680-e663b23f5016]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:04 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:27:04 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:05 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.630s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:05 devstack sudo[101773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e
Jul 23 03:27:05 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:05 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e" returned: 0 in 0.577s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:05 devstack sudo[101804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e
Jul 23 03:27:05 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:05 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=124,cinder:INSERT=40,cinder:UPDATE=139,cinder:DELETE=9 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:27:05 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=135,cinder:UPDATE=121,cinder:INSERT=42,cinder:DELETE=14 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:27:06 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2.64755f2c-b265-44ff-bce2-538662720e4e" returned: 0 in 0.443s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-64755f2c-b265-44ff-bce2-538662720e4e" released by "_delete_snapshot" :: held 2.273s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-1516a928-378e-4e92-97cf-103964c66ff2" released by "delete_snapshot" :: held 2.315s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Created reservations ['5c6ebda4-5cd7-4a29-bf41-759094077351', '1290e730-10ab-4647-87e3-92b75d3dbfb1', '82cf1920-2fca-44fd-96b2-7ef0e95db931', '910c853a-12a3-4522-a852-270053345720'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:06 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Delete snapshot completed successfully.
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-64755f2c-b265-44ff-bce2-538662720e4e-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Snapshots deleted, issuing volume delete {{(pid=88344) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-1516a928-378e-4e92-97cf-103964c66ff2" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-1516a928-378e-4e92-97cf-103964c66ff2" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a94a0-7bd7-494b-813a-5a4a84068503]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:06 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:27:06 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:07 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.563s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:07 devstack sudo[101812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2
Jul 23 03:27:07 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:07 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1516a928-378e-4e92-97cf-103964c66ff2" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-1516a928-378e-4e92-97cf-103964c66ff2" released by "delete_volume" :: held 1.097s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Created reservations ['81ba2d0e-e1d8-4a9c-a97d-09243dcd2048', '5eb8fe40-0da6-4d56-a495-f69f075be4c4', '52f5e79d-4f39-4b1d-b85c-7b77aea9ba7b', '93b9a920-b0dd-40e5-868a-c79457e97d98'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:07 devstack sudo[101815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:07 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:08 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.332s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Deleted volume successfully.
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd0a536c-9469-4a7f-8240-ce09edc28665 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-1516a928-378e-4e92-97cf-103964c66ff2-delete_volume" released by "delete_volume" :: held 4.469s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-6626d533-8267-4039-877e-830939c367a8-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-6626d533-8267-4039-877e-830939c367a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "cinder-quobyte-6626d533-8267-4039-877e-830939c367a8" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-6626d533-8267-4039-877e-830939c367a8" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb3e3ee-0188-415c-b005-3275cbf360fb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:08 devstack sudo[101821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8
Jul 23 03:27:08 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:09 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8" returned: 0 in 0.528s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:09 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8
Jul 23 03:27:09 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Acquiring lock "cinder-b9c235c8-078b-4114-86e0-46380d33100c-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:09 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6626d533-8267-4039-877e-830939c367a8" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Lock "cinder-b9c235c8-078b-4114-86e0-46380d33100c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-quobyte-6626d533-8267-4039-877e-830939c367a8" released by "delete_volume" :: held 0.925s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Acquiring lock "cinder-quobyte-b9c235c8-078b-4114-86e0-46380d33100c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Lock "cinder-quobyte-b9c235c8-078b-4114-86e0-46380d33100c" acquired by "delete_volume" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Created reservations ['a2a8f321-6d10-40fb-b4e1-bd84eea302b9', '52248d5c-07ca-4785-8cad-27cb4cbd8326', 'e3258773-9bca-4481-b45d-3042120956ff', 'ffc3406c-06c0-40fe-8d43-b33e366e49ad'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c829f47-641e-473e-a937-79ca0b24aa50]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:09 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c
Jul 23 03:27:09 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:09 devstack sudo[101833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:09 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:09 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.309s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:09 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Deleted volume successfully.
Jul 23 03:27:10 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c" returned: 0 in 0.474s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a81b1a97-8176-4c33-9824-51d23e228018 tempest-VolumesDeleteCascade-839016849 None] Lock "cinder-6626d533-8267-4039-877e-830939c367a8-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:10 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c
Jul 23 03:27:10 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:10 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b9c235c8-078b-4114-86e0-46380d33100c" returned: 0 in 0.262s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Lock "cinder-quobyte-b9c235c8-078b-4114-86e0-46380d33100c" released by "delete_volume" :: held 0.815s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Created reservations ['802bfb25-1584-4231-ba38-66ac847346bc', '1aedc9e5-71cc-42d8-b95f-dd8731c054b3', '323983d4-32ea-481a-b95a-e2f746dd6a79', '0a0b3ea2-4f1a-4141-a9fa-d0eb565cf0b3'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:10 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:10 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:10 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Deleted volume successfully.
Jul 23 03:27:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5d083c4e-3dd8-4576-b135-f0c7f21b1a57 tempest-VolumesNegativeTest-1733075223 None] Lock "cinder-b9c235c8-078b-4114-86e0-46380d33100c-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:16 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Flow 'volume_create_manager' (5affcf5b-bb53-4e94-b591-204c183ca20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b7a266-eaeb-435f-843c-14bc446bf65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b7a266-eaeb-435f-843c-14bc446bf65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1663604469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3de5cf-93c1-431d-bd0d-4c19349846db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78bbfed7636438b8e18d26829839288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:17Z,use_quota=True,user_id='6920883f266f4ad19220b79175658acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5079174-afc9-4776-b008-b46a3edec708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5079174-afc9-4776-b008-b46a3edec708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0473778-4c66-4c3d-b164-11132f17e104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0473778-4c66-4c3d-b164-11132f17e104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3de5cf-93c1-431d-bd0d-4c19349846db', 'volume_name': 'volume-cb3de5cf-93c1-431d-bd0d-4c19349846db', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ffca57-d9b2-4e9a-8496-be759261035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ffca57-d9b2-4e9a-8496-be759261035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ed73b1-abb3-45a3-acaa-3d7fcb441960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:17 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Volume cb3de5cf-93c1-431d-bd0d-4c19349846db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3de5cf-93c1-431d-bd0d-4c19349846db', 'volume_size': 1}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1663604469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3de5cf-93c1-431d-bd0d-4c19349846db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78bbfed7636438b8e18d26829839288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:17Z,use_quota=True,user_id='6920883f266f4ad19220b79175658acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Creating volume cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:17 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:17 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db 1073741824
Jul 23 03:27:17 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:17 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db 1073741824" returned: 0 in 0.626s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:17 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:17 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:18 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.320s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ed73b1-abb3-45a3-acaa-3d7fcb441960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3de5cf-93c1-431d-bd0d-4c19349846db', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae050171-7604-47b1-9a73-6019dd2d3414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:18 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Volume volume-cb3de5cf-93c1-431d-bd0d-4c19349846db (cb3de5cf-93c1-431d-bd0d-4c19349846db): created successfully
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae050171-7604-47b1-9a73-6019dd2d3414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Flow 'volume_create_manager' (5affcf5b-bb53-4e94-b591-204c183ca20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-466decee-a2c3-4755-9a25-1247577e1c64 tempest-VolumeDependencyTests-314306837 None] Created volume successfully.
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Creating offline snapshot b40c5acb-2852-4b07-8436-f3a959080b26 of volume cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f6f2f-b780-4bc8-86cd-c1aead879c02]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:19 devstack sudo[101870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:19 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:19 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.600s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:20 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 1G
Jul 23 03:27:20 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:20 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 1G" returned: 0 in 0.711s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3de5cf-93c1-431d-bd0d-4c19349846db -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:20 devstack sudo[101902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3de5cf-93c1-431d-bd0d-4c19349846db -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26
Jul 23 03:27:20 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9e002260-90af-437c-b828-0674b5be5ad5 req-5a108e04-aa36-49ba-aaf6-a132ddcbe77a tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:21 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3de5cf-93c1-431d-bd0d-4c19349846db -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26" returned: 0 in 0.491s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:21 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 is being set with open permissions: ugo+rw
Jul 23 03:27:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:21 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26
Jul 23 03:27:21 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:21 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26" returned: 0 in 0.291s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:21 devstack sudo[101910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info
Jul 23 03:27:21 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:21 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info" returned: 0 in 0.323s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:21 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info is being set with open permissions: ugo+rw
Jul 23 03:27:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:21 devstack sudo[101913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info
Jul 23 03:27:21 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:22 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.info" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9e002260-90af-437c-b828-0674b5be5ad5 req-5a108e04-aa36-49ba-aaf6-a132ddcbe77a tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.219s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9e002260-90af-437c-b828-0674b5be5ad5 req-5a108e04-aa36-49ba-aaf6-a132ddcbe77a tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ceca04d5-f977-426b-b232-4c891a686651 tempest-VolumeDependencyTests-314306837 None] Create snapshot completed successfully
Jul 23 03:27:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-9e002260-90af-437c-b828-0674b5be5ad5 req-5a108e04-aa36-49ba-aaf6-a132ddcbe77a tempest-TestInstancesWithCinderVolumes-1352807198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-4959f669-2c11-4b5c-93a7-03354faf7081', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79f54f01-bfa4-4776-8465-cc22b409f409', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:27:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-9e002260-90af-437c-b828-0674b5be5ad5 req-5a108e04-aa36-49ba-aaf6-a132ddcbe77a tempest-TestInstancesWithCinderVolumes-1352807198 None] attachment_update completed successfully.
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Flow 'volume_create_manager' (cca6f2cc-445d-4003-8e34-9a4845d6ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8abcce-04cd-40fe-8ac7-c4cbfb11e4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8abcce-04cd-40fe-8ac7-c4cbfb11e4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-26535696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac849603-84d2-4e27-b2e1-2a8029c5200b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78bbfed7636438b8e18d26829839288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b40c5acb-2852-4b07-8436-f3a959080b26,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:23Z,use_quota=True,user_id='6920883f266f4ad19220b79175658acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30599980-51e6-4f54-b62a-a15b2cfb7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30599980-51e6-4f54-b62a-a15b2cfb7611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8b2a85-4dc1-440d-9925-85d3b9f1d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8b2a85-4dc1-440d-9925-85d3b9f1d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac849603-84d2-4e27-b2e1-2a8029c5200b', 'volume_name': 'volume-ac849603-84d2-4e27-b2e1-2a8029c5200b', 'volume_size': 1, 'snapshot_id': 'b40c5acb-2852-4b07-8436-f3a959080b26'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c769bcf-ff7f-4f45-ace6-f376ee5b59fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c769bcf-ff7f-4f45-ace6-f376ee5b59fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d458016f-cdde-4d00-86b2-73c23b5623c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:23 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Volume ac849603-84d2-4e27-b2e1-2a8029c5200b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac849603-84d2-4e27-b2e1-2a8029c5200b', 'volume_size': 1, 'snapshot_id': 'b40c5acb-2852-4b07-8436-f3a959080b26'}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-quobyte-b40c5acb-2852-4b07-8436-f3a959080b26-ac849603-84d2-4e27-b2e1-2a8029c5200b" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-b40c5acb-2852-4b07-8436-f3a959080b26-ac849603-84d2-4e27-b2e1-2a8029c5200b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Creating volume ac849603-84d2-4e27-b2e1-2a8029c5200b from snapshot b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-quobyte-ac849603-84d2-4e27-b2e1-2a8029c5200b" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-ac849603-84d2-4e27-b2e1-2a8029c5200b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] snapshot: b40c5acb-2852-4b07-8436-f3a959080b26, volume: ac849603-84d2-4e27-b2e1-2a8029c5200b,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c470f-cf63-46ff-b25d-d70caaec1b07]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:23 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26
Jul 23 03:27:23 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:24 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26" returned: 0 in 0.624s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb3de5cf-93c1-431d-bd0d-4c19349846db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23a218d-3ec6-4192-86fd-153f5f3ddda2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:24 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:24 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:24 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.539s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:27:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:24 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b
Jul 23 03:27:24 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-98c3761a-5dd3-4974-9e65-f462b7e7410b req-3fff746b-3c5d-48a0-ba59-824d0a13db61 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:30 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b" returned: 0 in 5.713s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd1060-aac0-4749-b5d0-bada053fba80]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:30 devstack sudo[101964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:30 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:31 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.668s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:27:31 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Converted 1024.00 MB image at 179.18 MB/s
Jul 23 03:27:31 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b is being set with open permissions: ugo+rw
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:31 devstack sudo[101970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b
Jul 23 03:27:31 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:31 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b" returned: 0 in 0.357s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-ac849603-84d2-4e27-b2e1-2a8029c5200b" released by "_copy_volume_from_snapshot" :: held 8.060s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-b40c5acb-2852-4b07-8436-f3a959080b26-ac849603-84d2-4e27-b2e1-2a8029c5200b" released by "_create_volume_from_snapshot" :: held 8.104s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.130s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-98c3761a-5dd3-4974-9e65-f462b7e7410b req-3fff746b-3c5d-48a0-ba59-824d0a13db61 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.220s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-98c3761a-5dd3-4974-9e65-f462b7e7410b req-3fff746b-3c5d-48a0-ba59-824d0a13db61 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d458016f-cdde-4d00-86b2-73c23b5623c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac849603-84d2-4e27-b2e1-2a8029c5200b', 'volume_size': 1, 'snapshot_id': 'b40c5acb-2852-4b07-8436-f3a959080b26'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053ef936-b1cd-4dc6-8e8f-860bb0ee36c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:31 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Volume volume-ac849603-84d2-4e27-b2e1-2a8029c5200b (ac849603-84d2-4e27-b2e1-2a8029c5200b): created successfully
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053ef936-b1cd-4dc6-8e8f-860bb0ee36c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Flow 'volume_create_manager' (cca6f2cc-445d-4003-8e34-9a4845d6ac40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:31 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-98c3761a-5dd3-4974-9e65-f462b7e7410b req-3fff746b-3c5d-48a0-ba59-824d0a13db61 tempest-TestInstancesWithCinderVolumes-1352807198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-e61e2594-724e-4243-90e4-b58d5351f33f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78c787e4-37b0-493e-936e-d38fd000ec61', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:27:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f56de486-3824-464a-b778-ad8cbddf75ee tempest-VolumeDependencyTests-314306837 None] Created volume successfully.
Jul 23 03:27:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-98c3761a-5dd3-4974-9e65-f462b7e7410b req-3fff746b-3c5d-48a0-ba59-824d0a13db61 tempest-TestInstancesWithCinderVolumes-1352807198 None] attachment_update completed successfully.
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-b40c5acb-2852-4b07-8436-f3a959080b26-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-b40c5acb-2852-4b07-8436-f3a959080b26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-quobyte-cb3de5cf-93c1-431d-bd0d-4c19349846db" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-cb3de5cf-93c1-431d-bd0d-4c19349846db" acquired by "delete_snapshot" :: waited 0.064s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-quobyte-b40c5acb-2852-4b07-8436-f3a959080b26" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-b40c5acb-2852-4b07-8436-f3a959080b26" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Deleting offline snapshot b40c5acb-2852-4b07-8436-f3a959080b26 of volume cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] snapshot_file for this snap is: volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[20888a4b-a9b7-488d-8b50-94c3844a00ad]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:32 devstack sudo[101979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26
Jul 23 03:27:32 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (ba66738f-da07-4fc6-89c4-5a56cdb0739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb845543-7b81-4c6c-931b-bae5b4cfe7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb845543-7b81-4c6c-931b-bae5b4cfe7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-948992930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00d08db-f39a-46d2-a1c0-b8fd801dd0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:33Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8f7026-e765-44e2-919e-11b75c94abaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8f7026-e765-44e2-919e-11b75c94abaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcb4c53-e99e-4a08-a324-7073374b39cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcb4c53-e99e-4a08-a324-7073374b39cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00d08db-f39a-46d2-a1c0-b8fd801dd0cd', 'volume_name': 'volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc33f80-d349-4834-b015-fc900f83fddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc33f80-d349-4834-b015-fc900f83fddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3185841a-350d-4048-b59d-2b140a3a95cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Volume f00d08db-f39a-46d2-a1c0-b8fd801dd0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd', 'volume_size': 1}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-948992930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00d08db-f39a-46d2-a1c0-b8fd801dd0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:33Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Creating volume f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:33 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:33 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd 1073741824
Jul 23 03:27:33 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:33 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26" returned: 0 in 0.583s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb3de5cf-93c1-431d-bd0d-4c19349846db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb16e21-2680-410f-ad40-d2a358c878a6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:33 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:33 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:33 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd 1073741824" returned: 0 in 0.710s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:34 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd
Jul 23 03:27:34 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:34 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.754s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:34 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26
Jul 23 03:27:34 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:34 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3185841a-350d-4048-b59d-2b140a3a95cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c224b0b-93f7-4fbe-b07a-ebceedf2008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:34 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Volume volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd (f00d08db-f39a-46d2-a1c0-b8fd801dd0cd): created successfully
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c224b0b-93f7-4fbe-b07a-ebceedf2008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (ba66738f-da07-4fc6-89c4-5a56cdb0739b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-42ea17f9-4ec1-438b-9d13-1be3982e985e tempest-VolumesSnapshotTestJSON-871571642 None] Created volume successfully.
Jul 23 03:27:34 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26" returned: 0 in 0.429s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:34 devstack sudo[102050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26
Jul 23 03:27:34 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:34 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db.b40c5acb-2852-4b07-8436-f3a959080b26" returned: 0 in 0.424s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-b40c5acb-2852-4b07-8436-f3a959080b26" released by "_delete_snapshot" :: held 2.432s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-cb3de5cf-93c1-431d-bd0d-4c19349846db" released by "delete_snapshot" :: held 2.482s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Created reservations ['cf152503-9d48-467d-92ae-b9357dda727b', 'bce478e2-0c06-495e-b54e-9e96dbbddf27', '71e7b11a-a631-43db-b3b6-1e0245dd9629', '68f127e3-7467-4cc9-9a62-2507615b6f98'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:35 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Delete snapshot completed successfully.
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a0822289-b47a-4b40-bc3a-0481084f4d77 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-b40c5acb-2852-4b07-8436-f3a959080b26-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Creating offline snapshot 5a02c096-e324-4efe-bbaa-a874b59365f2 of volume f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae70ac1e-c8bb-4fba-bd64-bf6693195df0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-cb3de5cf-93c1-431d-bd0d-4c19349846db-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-cb3de5cf-93c1-431d-bd0d-4c19349846db-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:35 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd
Jul 23 03:27:35 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-quobyte-cb3de5cf-93c1-431d-bd0d-4c19349846db" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-cb3de5cf-93c1-431d-bd0d-4c19349846db" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:36 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7c76e2-dc29-4392-9e84-1cf001f45542]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:36 devstack sudo[102056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:36 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:36 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" returned: 0 in 0.694s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:36 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 1G
Jul 23 03:27:36 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:36 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.695s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:36 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db
Jul 23 03:27:36 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:37 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 1G" returned: 0 in 0.690s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:37 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2
Jul 23 03:27:37 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:37 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cb3de5cf-93c1-431d-bd0d-4c19349846db" returned: 0 in 0.460s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-cb3de5cf-93c1-431d-bd0d-4c19349846db" released by "delete_volume" :: held 1.252s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Created reservations ['46d74a1a-878c-4061-8bcd-3cdcd3091912', 'ffb7f16c-4bda-4125-8344-b94b25320940', '8cba06f1-0d51-4dc9-b40d-7b55edeabfeb', '620e122f-3d55-4d2b-9dcc-8f2dd80b6917'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:37 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:37 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:37 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2" returned: 0 in 0.437s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:37 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 is being set with open permissions: ugo+rw
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:37 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2
Jul 23 03:27:37 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:37 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.337s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Deleted volume successfully.
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8ba5577f-cfb0-4095-b44e-f64862ea2b69 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-cb3de5cf-93c1-431d-bd0d-4c19349846db-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:37 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2" returned: 0 in 0.324s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:37 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info
Jul 23 03:27:37 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-ac849603-84d2-4e27-b2e1-2a8029c5200b-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:38 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-ac849603-84d2-4e27-b2e1-2a8029c5200b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info" returned: 0 in 0.355s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:38 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info is being set with open permissions: ugo+rw
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:38 devstack sudo[102110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info
Jul 23 03:27:38 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "cinder-quobyte-ac849603-84d2-4e27-b2e1-2a8029c5200b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-ac849603-84d2-4e27-b2e1-2a8029c5200b" acquired by "delete_volume" :: waited 0.037s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99800ed-a2a4-4c22-a230-c05c83d77cac]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:38 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b
Jul 23 03:27:38 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:38 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.info" returned: 0 in 0.323s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-bc45dbb3-1060-4d2a-b843-9a730ed6f702 tempest-VolumesSnapshotTestJSON-871571642 None] Create snapshot completed successfully
Jul 23 03:27:38 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b" returned: 0 in 0.544s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:39 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b
Jul 23 03:27:39 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:39 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-ac849603-84d2-4e27-b2e1-2a8029c5200b" returned: 0 in 0.267s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-quobyte-ac849603-84d2-4e27-b2e1-2a8029c5200b" released by "delete_volume" :: held 0.888s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Created reservations ['0c931432-eaea-4d22-bb04-f666ec18e936', '5f08c43d-f9fd-4a78-b149-fe32570016f8', 'be2c43d5-608b-437b-a616-9f3f4e93519d', '32fd2d68-ffdf-4b58-b44b-bdd8cde67b49'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-283ae4f2-6979-4dbe-917c-30528168a75d req-9f8439f7-0d62-4a85-9dbe-536f793b785b tempest-TestInstancesWithCinderVolumes-1352807198 None] Terminate volume connection completed successfully.
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-283ae4f2-6979-4dbe-917c-30528168a75d req-9f8439f7-0d62-4a85-9dbe-536f793b785b tempest-TestInstancesWithCinderVolumes-1352807198 None] Deleting attachment 79f54f01-bfa4-4776-8465-cc22b409f409. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:39 devstack sudo[102126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:39 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:39 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Deleted volume successfully.
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f13e16a7-f09b-4c86-9bdf-3344acfa3315 tempest-VolumeDependencyTests-314306837 None] Lock "cinder-ac849603-84d2-4e27-b2e1-2a8029c5200b-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-5a02c096-e324-4efe-bbaa-a874b59365f2-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-5a02c096-e324-4efe-bbaa-a874b59365f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "cinder-4959f669-2c11-4b5c-93a7-03354faf7081-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-4959f669-2c11-4b5c-93a7-03354faf7081-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-5a02c096-e324-4efe-bbaa-a874b59365f2" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "cinder-quobyte-4959f669-2c11-4b5c-93a7-03354faf7081" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-5a02c096-e324-4efe-bbaa-a874b59365f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Deleting offline snapshot 5a02c096-e324-4efe-bbaa-a874b59365f2 of volume f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] snapshot_file for this snap is: volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-quobyte-4959f669-2c11-4b5c-93a7-03354faf7081" acquired by "delete_volume" :: waited 0.054s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8969eb9-672f-4620-acc3-55d44c581d40]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6345b6c-81e7-40a2-970c-10cf9e9d9c10]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:40 devstack sudo[102133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2
Jul 23 03:27:40 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:40 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081
Jul 23 03:27:40 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:40 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2" returned: 0 in 0.565s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c1e0dd-b07b-4d2a-88ec-182a855c0c81]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:40 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081" returned: 0 in 0.625s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:40 devstack sudo[102145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081
Jul 23 03:27:40 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:40 devstack sudo[102144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd
Jul 23 03:27:40 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:41 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4959f669-2c11-4b5c-93a7-03354faf7081" returned: 0 in 0.437s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-quobyte-4959f669-2c11-4b5c-93a7-03354faf7081" released by "delete_volume" :: held 1.131s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:41 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" returned: 0 in 0.564s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:41 devstack cinder-volume[88344]: WARNING cinder.quota [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1160255685-1371299234 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1160255685-1371299234, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:27:41 devstack cinder-volume[88344]: WARNING cinder.quota [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1160255685-1371299234 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1160255685-1371299234, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:27:41 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2
Jul 23 03:27:41 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Created reservations ['9b1a375c-0753-4386-97d5-6b4c1ace856e', 'fc8af105-581b-402f-86e2-6fc54c015569', '8ca8bd03-ddcd-4ff7-ab8e-8ec2b1d212c7', 'd84adfb7-58fe-425f-bbc7-6320d5a366c0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:41 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:41 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:41 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2" returned: 0 in 0.613s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:42 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2
Jul 23 03:27:42 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:42 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.569s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Deleted volume successfully.
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-50f3f779-98db-4054-ba54-53c61bcd78da tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-4959f669-2c11-4b5c-93a7-03354faf7081-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:42 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd.5a02c096-e324-4efe-bbaa-a874b59365f2" returned: 0 in 0.367s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-5a02c096-e324-4efe-bbaa-a874b59365f2" released by "_delete_snapshot" :: held 2.292s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" released by "delete_snapshot" :: held 2.321s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['87611efe-1b11-4dad-b5b1-2dbf63139a38', 'a7fabfc2-32d0-4cfb-9b95-bfc8eaed0c30', '5b1ef9d7-8ed2-4aca-87e8-fa1aacf11b57', '14362be9-7645-4a64-9bc8-1f545af3146e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Delete snapshot completed successfully.
Jul 23 03:27:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-47897050-51ae-4d0f-a5ba-763a15d706a6 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-5a02c096-e324-4efe-bbaa-a874b59365f2-delete_snapshot" released by "delete_snapshot" :: held 2.616s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (69899b52-0bc3-4b01-a43e-c5e1302a60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6474a1c-1a03-4369-8e1a-444c03818349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6474a1c-1a03-4369-8e1a-444c03818349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297713788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159a5879-2452-47a2-9fbe-dc24299079d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:44Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2219631d-2f73-4c0c-8008-ce0c2caddf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2219631d-2f73-4c0c-8008-ce0c2caddf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f134badc-f359-4e4f-9c91-0330adf9ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f134badc-f359-4e4f-9c91-0330adf9ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159a5879-2452-47a2-9fbe-dc24299079d5', 'volume_name': 'volume-159a5879-2452-47a2-9fbe-dc24299079d5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a0650-f8aa-4ba0-b896-11c1074be98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a0650-f8aa-4ba0-b896-11c1074be98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f37edd-d776-44c6-9a3a-49e8cf8a50e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:44 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Volume 159a5879-2452-47a2-9fbe-dc24299079d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159a5879-2452-47a2-9fbe-dc24299079d5', 'volume_size': 1}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297713788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159a5879-2452-47a2-9fbe-dc24299079d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:44Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Creating volume 159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:44 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:27:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:44 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 1073741824
Jul 23 03:27:44 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:45 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 1073741824" returned: 0 in 0.773s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:45 devstack sudo[102196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:27:45 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-7df64c7c-519a-4591-b019-0f564a205ee4 req-ea56c52e-7510-4dcc-9f8d-91ab081c1e28 tempest-TestInstancesWithCinderVolumes-1352807198 None] Terminate volume connection completed successfully.
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-7df64c7c-519a-4591-b019-0f564a205ee4 req-ea56c52e-7510-4dcc-9f8d-91ab081c1e28 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deleting attachment 78c787e4-37b0-493e-936e-d38fd000ec61. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:27:45 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.526s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f37edd-d776-44c6-9a3a-49e8cf8a50e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159a5879-2452-47a2-9fbe-dc24299079d5', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2310ddd-702a-46fa-a7a4-c4237b8f4a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:45 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Volume volume-159a5879-2452-47a2-9fbe-dc24299079d5 (159a5879-2452-47a2-9fbe-dc24299079d5): created successfully
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2310ddd-702a-46fa-a7a4-c4237b8f4a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (69899b52-0bc3-4b01-a43e-c5e1302a60ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "cinder-e61e2594-724e-4243-90e4-b58d5351f33f-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-805d824c-97b4-435a-8553-3e3bdaa9cdb7 tempest-VolumesSnapshotTestJSON-871571642 None] Created volume successfully.
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-e61e2594-724e-4243-90e4-b58d5351f33f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "cinder-quobyte-e61e2594-724e-4243-90e4-b58d5351f33f" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-quobyte-e61e2594-724e-4243-90e4-b58d5351f33f" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f4e22-1ee8-47c5-9915-9b9dcff1e5e5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:46 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f
Jul 23 03:27:46 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:46 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f" returned: 0 in 0.633s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:46 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f
Jul 23 03:27:46 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Flow 'volume_create_manager' (5522eb77-c0d4-4bac-9264-379ce0556318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ef8e20-b99d-40b9-9e26-76b64927cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ef8e20-b99d-40b9-9e26-76b64927cecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5430570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23289cb-29e3-461e-9305-e01660029104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381c0e7b76a04cad8e76b9b2479c44d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:47Z,use_quota=True,user_id='9ece14ebace14d69b26c94cb943447e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d47dea-12a1-4485-b70e-d91e1938cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d47dea-12a1-4485-b70e-d91e1938cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5522c252-4901-40d4-9b47-c24faa7e4ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5522c252-4901-40d4-9b47-c24faa7e4ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23289cb-29e3-461e-9305-e01660029104', 'volume_name': 'volume-b23289cb-29e3-461e-9305-e01660029104', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cbb6cd-da88-4e4e-a82e-8156b280c49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cbb6cd-da88-4e4e-a82e-8156b280c49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7530ff-263a-443c-b161-c23c8468279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:46 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Volume b23289cb-29e3-461e-9305-e01660029104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23289cb-29e3-461e-9305-e01660029104', 'volume_size': 1}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5430570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23289cb-29e3-461e-9305-e01660029104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381c0e7b76a04cad8e76b9b2479c44d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:47Z,use_quota=True,user_id='9ece14ebace14d69b26c94cb943447e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Creating volume b23289cb-29e3-461e-9305-e01660029104 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:46 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:46 devstack sudo[102207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104 1073741824
Jul 23 03:27:46 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:47 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e61e2594-724e-4243-90e4-b58d5351f33f" returned: 0 in 0.471s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-quobyte-e61e2594-724e-4243-90e4-b58d5351f33f" released by "delete_volume" :: held 1.175s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:47 devstack cinder-volume[88344]: WARNING cinder.quota [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418051026-551589516 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418051026-551589516, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:27:47 devstack cinder-volume[88344]: WARNING cinder.quota [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418051026-551589516 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1418051026-551589516, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Created reservations ['47e7a98f-75f4-421c-adbd-59fffe1dbc31', '358d0bc1-7c26-418d-9ca3-3eca936eef80', 'f361c1f8-1245-4f49-923b-8665155b3ba0', 'eaa12de8-07ef-4366-9299-be5260cfef18'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:47 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:47 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:47 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104 1073741824" returned: 0 in 0.655s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:47 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104
Jul 23 03:27:47 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:47 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.402s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deleted volume successfully.
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f90a7ff6-a9f7-408c-90ae-8126011bd465 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-e61e2594-724e-4243-90e4-b58d5351f33f-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:47 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104" returned: 0 in 0.272s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.933s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7530ff-263a-443c-b161-c23c8468279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23289cb-29e3-461e-9305-e01660029104', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c08e748-793d-448b-aa5c-b9cca49a454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Creating offline snapshot 3d18ef42-da5c-4f75-818c-a58ece01e981 of volume 159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:27:47 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Volume volume-b23289cb-29e3-461e-9305-e01660029104 (b23289cb-29e3-461e-9305-e01660029104): created successfully
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c08e748-793d-448b-aa5c-b9cca49a454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Flow 'volume_create_manager' (5522eb77-c0d4-4bac-9264-379ce0556318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b42a43e-23de-475c-8a10-ae8f71012ea6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-817cef20-00ae-4651-ad62-d4b5c414548a tempest-ProjectReaderTests-914734896 None] Created volume successfully.
Jul 23 03:27:48 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:27:48 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:48 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.439s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:48 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 1G
Jul 23 03:27:48 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Acquiring lock "cinder-b23289cb-29e3-461e-9305-e01660029104-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Lock "cinder-b23289cb-29e3-461e-9305-e01660029104-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Acquiring lock "cinder-quobyte-b23289cb-29e3-461e-9305-e01660029104" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:49 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 1G" returned: 0 in 0.679s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159a5879-2452-47a2-9fbe-dc24299079d5 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Lock "cinder-quobyte-b23289cb-29e3-461e-9305-e01660029104" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:49 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159a5879-2452-47a2-9fbe-dc24299079d5 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981
Jul 23 03:27:49 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa8277-ac92-4708-84b2-3715a831fd62]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:49 devstack sudo[102234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104
Jul 23 03:27:49 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:49 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159a5879-2452-47a2-9fbe-dc24299079d5 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981" returned: 0 in 0.515s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:49 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 is being set with open permissions: ugo+rw
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:49 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981
Jul 23 03:27:49 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:49 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104" returned: 0 in 0.532s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:49 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104
Jul 23 03:27:49 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:49 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981" returned: 0 in 0.367s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:50 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info
Jul 23 03:27:50 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:50 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b23289cb-29e3-461e-9305-e01660029104" returned: 0 in 0.429s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Lock "cinder-quobyte-b23289cb-29e3-461e-9305-e01660029104" released by "delete_volume" :: held 1.032s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Created reservations ['87f5926f-46ec-4126-b032-a4d0c08e2fd3', '5555b541-30e5-4403-9919-8223b3de28e1', 'f72f0b9c-343a-40c7-a5f7-acb6666fa67c', 'b9106c38-904a-4f71-8ad6-5c9a1fb01489'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:50 devstack sudo[102257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:50 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:50 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:50 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info is being set with open permissions: ugo+rw
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:50 devstack sudo[102260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info
Jul 23 03:27:50 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:50 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.453s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Deleted volume successfully.
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f9f9f33b-03a1-428d-8b50-964977168d6c tempest-ProjectReaderTests-914734896 None] Lock "cinder-b23289cb-29e3-461e-9305-e01660029104-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:50 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.info" returned: 0 in 0.524s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.169s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6b882ba9-5c78-4b59-a653-eb4597f48eda tempest-VolumesSnapshotTestJSON-871571642 None] Create snapshot completed successfully
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Flow 'volume_create_manager' (5e7f2e1c-c299-4765-a903-63b8843a3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148a15a9-fd62-467f-8869-7c4d6a004609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148a15a9-fd62-467f-8869-7c4d6a004609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580415109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2240c905-3263-4f7a-85cf-8c4a5e201209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381c0e7b76a04cad8e76b9b2479c44d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:52Z,use_quota=True,user_id='9ece14ebace14d69b26c94cb943447e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1d8594-8539-4eaf-9a05-e4de8045e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1d8594-8539-4eaf-9a05-e4de8045e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5daf6f6-42b4-4e2a-b4d8-70a2eb569b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5daf6f6-42b4-4e2a-b4d8-70a2eb569b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2240c905-3263-4f7a-85cf-8c4a5e201209', 'volume_name': 'volume-2240c905-3263-4f7a-85cf-8c4a5e201209', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a48025-8992-4961-a5f8-1017f0b6593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a48025-8992-4961-a5f8-1017f0b6593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107051a1-5f30-42fd-a427-51d6b05d935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:52 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Volume 2240c905-3263-4f7a-85cf-8c4a5e201209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2240c905-3263-4f7a-85cf-8c4a5e201209', 'volume_size': 1}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580415109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2240c905-3263-4f7a-85cf-8c4a5e201209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381c0e7b76a04cad8e76b9b2479c44d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:52Z,use_quota=True,user_id='9ece14ebace14d69b26c94cb943447e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Creating volume 2240c905-3263-4f7a-85cf-8c4a5e201209 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:52 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:52 devstack sudo[102289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209 1073741824
Jul 23 03:27:52 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:52 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209 1073741824" returned: 0 in 0.755s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:53 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209
Jul 23 03:27:53 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (7d138000-de23-4673-ae07-1e7d044cde0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8637403-1a57-4527-af94-e225a2e18198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8637403-1a57-4527-af94-e225a2e18198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-865878515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9a5f0-ecce-4c41-8294-5609ab0e447c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3d18ef42-da5c-4f75-818c-a58ece01e981,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:53Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8d2f51-4755-4660-b4e8-0b4f2969f01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8d2f51-4755-4660-b4e8-0b4f2969f01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7e4800-f511-4c59-8002-4e4a005aa770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7e4800-f511-4c59-8002-4e4a005aa770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ca9a5f0-ecce-4c41-8294-5609ab0e447c', 'volume_name': 'volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c', 'volume_size': 2, 'snapshot_id': '3d18ef42-da5c-4f75-818c-a58ece01e981'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ced5bea-5e6a-48b4-9399-0addb469198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ced5bea-5e6a-48b4-9399-0addb469198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ac6aba-1596-4e80-b9ad-5fd70b12d39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:53 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Volume 6ca9a5f0-ecce-4c41-8294-5609ab0e447c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c', 'volume_size': 2, 'snapshot_id': '3d18ef42-da5c-4f75-818c-a58ece01e981'}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:53 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209" returned: 0 in 0.387s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.070s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-3d18ef42-da5c-4f75-818c-a58ece01e981-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107051a1-5f30-42fd-a427-51d6b05d935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2240c905-3263-4f7a-85cf-8c4a5e201209', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6cdb1f-3c6a-4970-8523-72631b1461c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-3d18ef42-da5c-4f75-818c-a58ece01e981-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Creating volume 6ca9a5f0-ecce-4c41-8294-5609ab0e447c from snapshot 3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:53 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Volume volume-2240c905-3263-4f7a-85cf-8c4a5e201209 (2240c905-3263-4f7a-85cf-8c4a5e201209): created successfully
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6cdb1f-3c6a-4970-8523-72631b1461c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Flow 'volume_create_manager' (5e7f2e1c-c299-4765-a903-63b8843a3e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] snapshot: 3d18ef42-da5c-4f75-818c-a58ece01e981, volume: 6ca9a5f0-ecce-4c41-8294-5609ab0e447c,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:27:53 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3bc04b6c-f1ee-4294-935e-1e7edf9f5a2a tempest-ProjectReaderTests-914734896 None] Created volume successfully.
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[56edd5d9-65ed-4a78-a2a6-45d21dd3010a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:53 devstack sudo[102300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981
Jul 23 03:27:53 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:53 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-9a45fadf-e578-4bcb-9e6b-9a294fb12936 req-9ac5f5b1-ae83-42ac-b427-62c9db490b7d tempest-TestInstancesWithCinderVolumes-1352807198 None] Terminate volume connection completed successfully.
Jul 23 03:27:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-9a45fadf-e578-4bcb-9e6b-9a294fb12936 req-9ac5f5b1-ae83-42ac-b427-62c9db490b7d tempest-TestInstancesWithCinderVolumes-1352807198 None] Deleting attachment 619782e0-d637-4993-a0da-3fa8cbe301ae. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:27:54 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981" returned: 0 in 0.529s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159a5879-2452-47a2-9fbe-dc24299079d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e384b9eb-0cb2-43e2-9d2d-313e9724ec83]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Acquiring lock "cinder-2240c905-3263-4f7a-85cf-8c4a5e201209-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Lock "cinder-2240c905-3263-4f7a-85cf-8c4a5e201209-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Acquiring lock "cinder-quobyte-2240c905-3263-4f7a-85cf-8c4a5e201209" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Lock "cinder-quobyte-2240c905-3263-4f7a-85cf-8c4a5e201209" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:54 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:27:54 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8625350-65fb-4188-ab0f-b5d1ee8aa7ab]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:54 devstack sudo[102308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209
Jul 23 03:27:54 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:54 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.636s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:54 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c
Jul 23 03:27:54 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:54 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209" returned: 0 in 0.624s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:55 devstack sudo[102318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209
Jul 23 03:27:55 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:55 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-2240c905-3263-4f7a-85cf-8c4a5e201209" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Lock "cinder-quobyte-2240c905-3263-4f7a-85cf-8c4a5e201209" released by "delete_volume" :: held 1.008s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Created reservations ['c53e40ec-f6a7-4931-a9ef-8fed0c147c78', '3bd73215-f4ef-49c9-8253-fa49040bd06c', '5af40bfb-c48d-4c47-9814-86f838391865', '8181fd1a-6a07-4d3c-bb30-4b241b8447a5'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:55 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:55 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "cinder-c8f52a85-24ac-4768-ac43-c08264d046c4-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-c8f52a85-24ac-4768-ac43-c08264d046c4-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:56 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.505s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:56 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Deleted volume successfully.
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "cinder-quobyte-c8f52a85-24ac-4768-ac43-c08264d046c4" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-quobyte-c8f52a85-24ac-4768-ac43-c08264d046c4" acquired by "delete_volume" :: waited 0.057s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b0430192-8cb2-4d22-a2f7-2c9aa7dde133 tempest-ProjectReaderTests-914734896 None] Lock "cinder-2240c905-3263-4f7a-85cf-8c4a5e201209-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c94fc07-4ab2-49ba-8cc1-ad554d94abfe]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:27:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:56 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4
Jul 23 03:27:56 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:57 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4" returned: 0 in 1.222s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:57 devstack sudo[102341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4
Jul 23 03:27:57 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:58 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c8f52a85-24ac-4768-ac43-c08264d046c4" returned: 0 in 0.791s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-quobyte-c8f52a85-24ac-4768-ac43-c08264d046c4" released by "delete_volume" :: held 2.122s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:27:58 devstack cinder-volume[88344]: WARNING cinder.quota [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103122455-160371894 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103122455-160371894, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:27:58 devstack cinder-volume[88344]: WARNING cinder.quota [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103122455-160371894 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-103122455-160371894, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Created reservations ['38b85676-a569-44f2-9123-f5830b02877b', '3af0329d-fa0d-4584-bab5-8b34b6429838', '54401f8f-4efd-497d-8c4b-6269a56e509c', '41cbb176-d4ed-4248-9aab-7d6eb14e5597'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:58 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:58 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:27:59 devstack sudo[102346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:27:59 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:27:59 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.630s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:27:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:28:00 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 1.041s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:00 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Deleted volume successfully.
Jul 23 03:28:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c6c36b74-e709-43a2-8306-584088e12c81 tempest-TestInstancesWithCinderVolumes-1352807198 None] Lock "cinder-c8f52a85-24ac-4768-ac43-c08264d046c4-delete_volume" released by "delete_volume" :: held 4.076s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:01 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" returned: 0 in 6.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed0ee3-3f79-4635-8c22-f6c1af82c673]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:01 devstack sudo[102353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:28:01 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:01 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.768s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:01 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:28:01 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Converted 1024.00 MB image at 161.84 MB/s
Jul 23 03:28:01 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c is being set with open permissions: ugo+rw
Jul 23 03:28:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:01 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c
Jul 23 03:28:01 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:02 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" returned: 0 in 0.478s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" released by "_copy_volume_from_snapshot" :: held 8.871s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-3d18ef42-da5c-4f75-818c-a58ece01e981-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" released by "_create_volume_from_snapshot" :: held 8.928s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.958s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ac6aba-1596-4e80-b9ad-5fd70b12d39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c', 'volume_size': 2, 'snapshot_id': '3d18ef42-da5c-4f75-818c-a58ece01e981'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fc8d73-049b-4f64-aacd-a2a1b3cae8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:02 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Volume volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c (6ca9a5f0-ecce-4c41-8294-5609ab0e447c): created successfully
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fc8d73-049b-4f64-aacd-a2a1b3cae8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (7d138000-de23-4673-ae07-1e7d044cde0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-787dc2d0-97c8-4694-93a2-834f6988ad50 tempest-VolumesSnapshotTestJSON-871571642 None] Created volume successfully.
Jul 23 03:28:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-6ca9a5f0-ecce-4c41-8294-5609ab0e447c-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-6ca9a5f0-ecce-4c41-8294-5609ab0e447c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638bbaf-729b-4043-a018-85a63b9815eb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:03 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c
Jul 23 03:28:03 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:04 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" returned: 0 in 0.529s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:04 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c
Jul 23 03:28:04 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:04 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" returned: 0 in 0.421s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-6ca9a5f0-ecce-4c41-8294-5609ab0e447c" released by "delete_volume" :: held 1.024s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['1c4d148d-b6dd-4e06-9f65-1d9198e02756', '15c22c0a-d136-4fad-91a4-489c3f22ab6d', '19e8eb98-87b9-471d-94dc-c8e3f039ad0c', '91330b4b-be33-45ab-a7a2-27d30dad8657'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:04 devstack sudo[102394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:04 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:05 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:05 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Deleted volume successfully.
Jul 23 03:28:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ce927f25-fd1e-4383-b2f3-6e7d09709878 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-6ca9a5f0-ecce-4c41-8294-5609ab0e447c-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-3d18ef42-da5c-4f75-818c-a58ece01e981-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-3d18ef42-da5c-4f75-818c-a58ece01e981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-159a5879-2452-47a2-9fbe-dc24299079d5" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-159a5879-2452-47a2-9fbe-dc24299079d5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-3d18ef42-da5c-4f75-818c-a58ece01e981" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-3d18ef42-da5c-4f75-818c-a58ece01e981" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Deleting offline snapshot 3d18ef42-da5c-4f75-818c-a58ece01e981 of volume 159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] snapshot_file for this snap is: volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0bccd3-d7af-470c-84f4-a2e30e65b7d3]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:06 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981
Jul 23 03:28:06 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:07 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981" returned: 0 in 0.943s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159a5879-2452-47a2-9fbe-dc24299079d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:28:07 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc97f71e-0473-4bea-af72-c1ebe22c2e72]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:07 devstack sudo[102448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:28:07 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:07 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.690s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:08 devstack sudo[102476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981
Jul 23 03:28:08 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:08 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981" returned: 0 in 0.547s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:08 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981
Jul 23 03:28:08 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:08 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5.3d18ef42-da5c-4f75-818c-a58ece01e981" returned: 0 in 0.395s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=125,cinder:INSERT=28,cinder:UPDATE=127,cinder:DELETE=8 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=111,cinder:INSERT=36,cinder:UPDATE=135,cinder:DELETE=13 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-3d18ef42-da5c-4f75-818c-a58ece01e981" released by "_delete_snapshot" :: held 2.795s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-159a5879-2452-47a2-9fbe-dc24299079d5" released by "delete_snapshot" :: held 2.840s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['b71ebf8a-9bb1-4d86-b476-2a1d8f8eedf3', '2371f8ad-ce47-452c-a874-3688cc2c8f58', '4ea0ac17-4045-40a2-ab57-d1c50de367f3', 'aec17d34-78dd-430f-8657-cebb19274fe0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:09 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Delete snapshot completed successfully.
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72d5b417-029e-4c3c-8e32-d762f3c39fb8 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-3d18ef42-da5c-4f75-818c-a58ece01e981-delete_snapshot" released by "delete_snapshot" :: held 3.033s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-159a5879-2452-47a2-9fbe-dc24299079d5-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-159a5879-2452-47a2-9fbe-dc24299079d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-159a5879-2452-47a2-9fbe-dc24299079d5" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-159a5879-2452-47a2-9fbe-dc24299079d5" acquired by "delete_volume" :: waited 0.049s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b759e-a69c-40ac-a808-4998473dd88d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:10 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:28:10 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:10 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.677s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:10 devstack sudo[102509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5
Jul 23 03:28:10 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:10 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-159a5879-2452-47a2-9fbe-dc24299079d5" returned: 0 in 0.421s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-159a5879-2452-47a2-9fbe-dc24299079d5" released by "delete_volume" :: held 1.256s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['e87957a5-fabc-4cdc-8064-3263bea345fc', '5345576e-5e77-4f01-b778-1a466135b635', '7d20c3dc-6287-473b-89a1-33a7cd5c4212', 'a11ed3e6-54ac-4c8f-98cf-22c164a31c4b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:11 devstack sudo[102513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:11 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:11 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.493s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Deleted volume successfully.
Jul 23 03:28:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f1d4c67c-6d84-4b42-9587-d44646b5ea7c tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-159a5879-2452-47a2-9fbe-dc24299079d5-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (e72879d0-c8fd-41b1-bc61-d92d27a8bb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1b1534-5850-4d5c-9376-ba0027b950f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1b1534-5850-4d5c-9376-ba0027b950f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-43987157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9503b9bb-bc57-43d8-a586-197ddca42b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:13Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20f3f2d-f6ea-4517-aa2f-3c6ef5467b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20f3f2d-f6ea-4517-aa2f-3c6ef5467b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fcf275-e0fe-4377-bdf9-280d181a0c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fcf275-e0fe-4377-bdf9-280d181a0c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9503b9bb-bc57-43d8-a586-197ddca42b66', 'volume_name': 'volume-9503b9bb-bc57-43d8-a586-197ddca42b66', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7129b2a2-00c2-42a2-9f79-88254e48f163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7129b2a2-00c2-42a2-9f79-88254e48f163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02c52cf-cf21-4324-8c75-9e58ab022520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Volume 9503b9bb-bc57-43d8-a586-197ddca42b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9503b9bb-bc57-43d8-a586-197ddca42b66', 'volume_size': 1}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-43987157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9503b9bb-bc57-43d8-a586-197ddca42b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:13Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Creating volume 9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:13 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:13 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 1073741824
Jul 23 03:28:13 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (8d04b4be-5cec-41fc-89f4-2e70c9c405d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9b778e-3ace-4b1e-a9cb-bb6327f42ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9b778e-3ace-4b1e-a9cb-bb6327f42ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058961078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01066306-c897-44e1-8a28-bc80b3dd0eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:14Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99fe5ca-80da-4fdf-a8a7-268cf829fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99fe5ca-80da-4fdf-a8a7-268cf829fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a88558-67af-4841-9326-afb5835430d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a88558-67af-4841-9326-afb5835430d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01066306-c897-44e1-8a28-bc80b3dd0eba', 'volume_name': 'volume-01066306-c897-44e1-8a28-bc80b3dd0eba', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b83496-8260-4ff4-a434-cdc5a51d2f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b83496-8260-4ff4-a434-cdc5a51d2f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020559dc-0c29-4de3-a7e8-0ed68e3e79b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:13 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Volume 01066306-c897-44e1-8a28-bc80b3dd0eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01066306-c897-44e1-8a28-bc80b3dd0eba', 'volume_size': 1}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:13 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 1073741824" returned: 0 in 0.923s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:14 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:14 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:14 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.437s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058961078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01066306-c897-44e1-8a28-bc80b3dd0eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:14Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Creating volume 01066306-c897-44e1-8a28-bc80b3dd0eba {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:14 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02c52cf-cf21-4324-8c75-9e58ab022520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9503b9bb-bc57-43d8-a586-197ddca42b66', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:14 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba 1073741824
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c0a31b-2467-4bbc-bb83-48ada25572a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:14 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:14 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Volume volume-9503b9bb-bc57-43d8-a586-197ddca42b66 (9503b9bb-bc57-43d8-a586-197ddca42b66): created successfully
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c0a31b-2467-4bbc-bb83-48ada25572a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (e72879d0-c8fd-41b1-bc61-d92d27a8bb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0ee1314a-76b1-4a15-b8fb-a53550501bd9 tempest-VolumesSnapshotTestJSON-871571642 None] Created volume successfully.
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:15 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba 1073741824" returned: 0 in 0.986s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:15 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba
Jul 23 03:28:15 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:15 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba" returned: 0 in 0.251s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.336s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020559dc-0c29-4de3-a7e8-0ed68e3e79b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01066306-c897-44e1-8a28-bc80b3dd0eba', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdad1244-f517-4e34-8825-7956895075d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Creating offline snapshot 1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 of volume 9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:28:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Volume volume-01066306-c897-44e1-8a28-bc80b3dd0eba (01066306-c897-44e1-8a28-bc80b3dd0eba): created successfully
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdad1244-f517-4e34-8825-7956895075d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (8d04b4be-5cec-41fc-89f4-2e70c9c405d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a546e43-6b64-4d01-b284-79fbe71a0305]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8bdce3a7-6467-44f8-8a59-4a8b749388a8 tempest-ProjectReaderTests-1578691462 None] Created volume successfully.
Jul 23 03:28:15 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:15 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:16 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:16 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 1G
Jul 23 03:28:16 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:16 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 1G" returned: 0 in 0.500s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9503b9bb-bc57-43d8-a586-197ddca42b66 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:16 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9503b9bb-bc57-43d8-a586-197ddca42b66 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7
Jul 23 03:28:16 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-01066306-c897-44e1-8a28-bc80b3dd0eba-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:17 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9503b9bb-bc57-43d8-a586-197ddca42b66 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:17 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 is being set with open permissions: ugo+rw
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Lock "cinder-01066306-c897-44e1-8a28-bc80b3dd0eba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:17 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7
Jul 23 03:28:17 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-quobyte-01066306-c897-44e1-8a28-bc80b3dd0eba" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-01066306-c897-44e1-8a28-bc80b3dd0eba" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c9002-7fdc-4a03-96d1-5210e50277da]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:17 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba
Jul 23 03:28:17 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:17 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:17 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info
Jul 23 03:28:17 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:17 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba" returned: 0 in 0.443s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:17 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba
Jul 23 03:28:17 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:17 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:17 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info is being set with open permissions: ugo+rw
Jul 23 03:28:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:18 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info
Jul 23 03:28:18 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:18 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01066306-c897-44e1-8a28-bc80b3dd0eba" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-01066306-c897-44e1-8a28-bc80b3dd0eba" released by "delete_volume" :: held 0.793s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Created reservations ['cd198f66-d543-4838-8690-ead73a897b2a', 'd08bb048-3a68-427e-a026-43153d939f25', 'd3fd44cc-83a9-47c2-8f98-f67db8c34d5e', '311f6165-e350-4a29-a4de-d8a625f0ab1f'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:18 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.info" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:18 devstack sudo[102579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:18 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-096276e5-8310-4547-8bd7-517a4e71f0c2 tempest-VolumesSnapshotTestJSON-871571642 None] Create snapshot completed successfully
Jul 23 03:28:18 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.547s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Deleted volume successfully.
Jul 23 03:28:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f7f6eae2-7843-4956-a927-c2653975073a tempest-ProjectReaderTests-1578691462 None] Lock "cinder-01066306-c897-44e1-8a28-bc80b3dd0eba-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (996b73f2-6bba-4552-bfce-f73bb09fdbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8f4027-6279-4e90-b81c-a5d113db863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8f4027-6279-4e90-b81c-a5d113db863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81730527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1dcf14-2276-4015-9dc4-c22549c93d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:19Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c836d0-afda-46dc-b714-ed986569072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c836d0-afda-46dc-b714-ed986569072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c266081-b5c1-4da0-a58b-c23451275d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c266081-b5c1-4da0-a58b-c23451275d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1dcf14-2276-4015-9dc4-c22549c93d21', 'volume_name': 'volume-de1dcf14-2276-4015-9dc4-c22549c93d21', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da36255f-a1d1-4b98-a918-78317dab75d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da36255f-a1d1-4b98-a918-78317dab75d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6c4209-f43d-4c46-a0e5-8c7010a28d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Volume de1dcf14-2276-4015-9dc4-c22549c93d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1dcf14-2276-4015-9dc4-c22549c93d21', 'volume_size': 1}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81730527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1dcf14-2276-4015-9dc4-c22549c93d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:19Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Creating volume de1dcf14-2276-4015-9dc4-c22549c93d21 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:19 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:19 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21 1073741824
Jul 23 03:28:19 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (a65efb11-f2a8-4e08-a986-69b738f1a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de93d59-7728-438e-bd48-bb758eab96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de93d59-7728-438e-bd48-bb758eab96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-689655459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c2a881-e18a-43cc-93ac-df40ce71ceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ce453a9409b440ebd3cf03e3d319211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:19Z,use_quota=True,user_id='6aef11935a3f453599e5523273d47679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63904a8b-7ee9-4198-8387-6bb9a562b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63904a8b-7ee9-4198-8387-6bb9a562b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d774c61-a350-4ccc-8ee9-8e5dbfefe207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d774c61-a350-4ccc-8ee9-8e5dbfefe207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58c2a881-e18a-43cc-93ac-df40ce71ceae', 'volume_name': 'volume-58c2a881-e18a-43cc-93ac-df40ce71ceae', 'volume_size': 1, 'snapshot_id': '1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad83ef-cc6e-4fc8-a7af-1a6551a08aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad83ef-cc6e-4fc8-a7af-1a6551a08aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b41e4f-c027-4719-a5f2-8881174ea602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Volume 58c2a881-e18a-43cc-93ac-df40ce71ceae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58c2a881-e18a-43cc-93ac-df40ce71ceae', 'volume_size': 1, 'snapshot_id': '1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7'}
Jul 23 03:28:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:20 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21 1073741824" returned: 0 in 0.671s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:20 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21
Jul 23 03:28:20 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:20 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21" returned: 0 in 0.274s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.846s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7-58c2a881-e18a-43cc-93ac-df40ce71ceae" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6c4209-f43d-4c46-a0e5-8c7010a28d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1dcf14-2276-4015-9dc4-c22549c93d21', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cfcb60-48c8-4a6c-8c47-1187dbcccde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7-58c2a881-e18a-43cc-93ac-df40ce71ceae" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Creating volume 58c2a881-e18a-43cc-93ac-df40ce71ceae from snapshot 1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-58c2a881-e18a-43cc-93ac-df40ce71ceae" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-58c2a881-e18a-43cc-93ac-df40ce71ceae" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] snapshot: 1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7, volume: 58c2a881-e18a-43cc-93ac-df40ce71ceae,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:28:20 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Volume volume-de1dcf14-2276-4015-9dc4-c22549c93d21 (de1dcf14-2276-4015-9dc4-c22549c93d21): created successfully
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cfcb60-48c8-4a6c-8c47-1187dbcccde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (996b73f2-6bba-4552-bfce-f73bb09fdbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5ac236d9-3fe8-422e-834c-fb4578edfada tempest-ProjectReaderTests-1578691462 None] Created volume successfully.
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82812a-4d40-4345-9b46-1d4c391907be]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:20 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7
Jul 23 03:28:20 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:21 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" returned: 0 in 0.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9503b9bb-bc57-43d8-a586-197ddca42b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a60b9-99ac-4413-bd39-b3d3a6174eb3]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:21 devstack sudo[102597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:21 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-de1dcf14-2276-4015-9dc4-c22549c93d21-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Lock "cinder-de1dcf14-2276-4015-9dc4-c22549c93d21-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-quobyte-de1dcf14-2276-4015-9dc4-c22549c93d21" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-de1dcf14-2276-4015-9dc4-c22549c93d21" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6488d1a6-3533-4f4e-9a8d-1592b6c23a7c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:21 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.543s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:21 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21
Jul 23 03:28:21 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:21 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae
Jul 23 03:28:21 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:21 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21" returned: 0 in 0.477s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:21 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21
Jul 23 03:28:21 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:22 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-de1dcf14-2276-4015-9dc4-c22549c93d21" returned: 0 in 0.342s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-de1dcf14-2276-4015-9dc4-c22549c93d21" released by "delete_volume" :: held 0.880s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Created reservations ['c1fd5d3f-a8e5-41e9-85b2-ae95213ad470', 'f3c236ad-b8e5-46eb-9d0d-82861ebb557a', 'c262a7a4-7f28-43b1-9bd2-802bd41c0678', '813d47ab-700e-4121-95b7-4ab6b7754884'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:22 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:22 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:22 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.357s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:22 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Deleted volume successfully.
Jul 23 03:28:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c692413e-2063-4fb2-82b2-f0aedd5db93b tempest-ProjectReaderTests-1578691462 None] Lock "cinder-de1dcf14-2276-4015-9dc4-c22549c93d21-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (2fb70b97-60d2-453f-b6bd-192cfed66470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d93d4c5-fbd8-44ac-b728-b70aecb60cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d93d4c5-fbd8-44ac-b728-b70aecb60cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291282668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c189227-3932-4a7f-b7a7-f7f11c59dd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:25Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d6a6a6-7213-47e7-9d1f-7ff2e42e1fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d6a6a6-7213-47e7-9d1f-7ff2e42e1fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5343eb47-051a-478c-bc2b-24d8d8897ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5343eb47-051a-478c-bc2b-24d8d8897ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c189227-3932-4a7f-b7a7-f7f11c59dd96', 'volume_name': 'volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d1105a-9c76-48d1-9c26-76487c404aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d1105a-9c76-48d1-9c26-76487c404aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da09ae20-8c00-40be-b24d-500748dab190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Volume 5c189227-3932-4a7f-b7a7-f7f11c59dd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96', 'volume_size': 1}
Jul 23 03:28:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:26 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae" returned: 0 in 4.950s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8463e80a-b6c6-452c-b93c-f63bc7bbbaf9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:26 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:26 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:27 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.658s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:28:27 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Converted 1024.00 MB image at 206.80 MB/s
Jul 23 03:28:27 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae is being set with open permissions: ugo+rw
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:27 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae
Jul 23 03:28:27 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:27 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-58c2a881-e18a-43cc-93ac-df40ce71ceae" released by "_copy_volume_from_snapshot" :: held 6.991s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7-58c2a881-e18a-43cc-93ac-df40ce71ceae" released by "_create_volume_from_snapshot" :: held 7.034s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.074s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291282668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c189227-3932-4a7f-b7a7-f7f11c59dd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:25Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Creating volume 5c189227-3932-4a7f-b7a7-f7f11c59dd96 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:27 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:27 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 1073741824
Jul 23 03:28:27 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b41e4f-c027-4719-a5f2-8881174ea602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c2a881-e18a-43cc-93ac-df40ce71ceae', 'volume_size': 1, 'snapshot_id': '1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0c26c7-7da6-4238-a76e-938552fd8177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Volume volume-58c2a881-e18a-43cc-93ac-df40ce71ceae (58c2a881-e18a-43cc-93ac-df40ce71ceae): created successfully
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0c26c7-7da6-4238-a76e-938552fd8177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Flow 'volume_create_manager' (a65efb11-f2a8-4e08-a986-69b738f1a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cfc8aa0a-3ecd-4fc5-8136-7cffa31848b4 tempest-VolumesSnapshotTestJSON-871571642 None] Created volume successfully.
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-58c2a881-e18a-43cc-93ac-df40ce71ceae-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-58c2a881-e18a-43cc-93ac-df40ce71ceae-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:28 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 1073741824" returned: 0 in 0.729s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-58c2a881-e18a-43cc-93ac-df40ce71ceae" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-58c2a881-e18a-43cc-93ac-df40ce71ceae" acquired by "delete_volume" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0301fb5b-ccc0-4e9c-b195-575f82b5081e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:28 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96
Jul 23 03:28:28 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:28 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae
Jul 23 03:28:28 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:28 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96" returned: 0 in 0.316s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da09ae20-8c00-40be-b24d-500748dab190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15f297e-9ce3-41b5-b3a4-862f109d7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:28 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Volume volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 (5c189227-3932-4a7f-b7a7-f7f11c59dd96): created successfully
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15f297e-9ce3-41b5-b3a4-862f109d7359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (2fb70b97-60d2-453f-b6bd-192cfed66470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a6a8e10a-711e-476d-88ce-e1a2b139a938 tempest-ProjectReaderTests-1578691462 None] Created volume successfully.
Jul 23 03:28:28 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae" returned: 0 in 0.487s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:28 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae
Jul 23 03:28:28 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:29 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-58c2a881-e18a-43cc-93ac-df40ce71ceae" returned: 0 in 0.288s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-58c2a881-e18a-43cc-93ac-df40ce71ceae" released by "delete_volume" :: held 0.845s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-5c189227-3932-4a7f-b7a7-f7f11c59dd96-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Lock "cinder-5c189227-3932-4a7f-b7a7-f7f11c59dd96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['8919f9e4-e3a4-4b0c-9884-1688cc5c58d8', '4b4cfd7c-4b30-4271-bf3f-7cbc2a8c7365', '30316af2-69e8-4b88-ae73-80e04ab617bd', '6349f328-21b9-44cc-a300-6b7ff7573d30'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-quobyte-5c189227-3932-4a7f-b7a7-f7f11c59dd96" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-5c189227-3932-4a7f-b7a7-f7f11c59dd96" acquired by "delete_volume" :: waited 0.048s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1dde7-8f21-42ba-b024-893de742ac2f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:29 devstack sudo[102672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:29 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-9503b9bb-bc57-43d8-a586-197ddca42b66" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-9503b9bb-bc57-43d8-a586-197ddca42b66" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:29 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96
Jul 23 03:28:29 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Deleting offline snapshot 1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 of volume 9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] snapshot_file for this snap is: volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c8bc99-ce65-44aa-b2b0-503ca1589402]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:29 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7
Jul 23 03:28:29 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:30 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.510s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Deleted volume successfully.
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-35a9cb95-49d6-4e9e-ad07-6e42760784ab tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-58c2a881-e18a-43cc-93ac-df40ce71ceae-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:30 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96" returned: 0 in 0.714s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:30 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96
Jul 23 03:28:30 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:30 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" returned: 0 in 0.693s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9503b9bb-bc57-43d8-a586-197ddca42b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[830af0ea-ea4c-4dcd-a123-48d2c978ccf5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:30 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c189227-3932-4a7f-b7a7-f7f11c59dd96" returned: 0 in 0.348s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-5c189227-3932-4a7f-b7a7-f7f11c59dd96" released by "delete_volume" :: held 1.155s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Created reservations ['056e483f-947e-472e-917a-c1feb3befa51', '377450a0-baec-4649-9b04-29be26b85356', 'c6c518bd-f014-4d30-a2d7-ef13a7889fc9', 'dce28ba9-684c-4efa-9a8b-38f5b31fca96'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:30 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:30 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:30 devstack sudo[102689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:30 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:31 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.702s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:31 devstack sudo[102694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7
Jul 23 03:28:31 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:31 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.513s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Deleted volume successfully.
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-aa9d4ab1-8ee0-4d58-a492-f6c95e3bc88e tempest-ProjectReaderTests-1578691462 None] Lock "cinder-5c189227-3932-4a7f-b7a7-f7f11c59dd96-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:31 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" returned: 0 in 0.592s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:31 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7
Jul 23 03:28:31 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:32 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66.1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" returned: 0 in 0.417s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7" released by "_delete_snapshot" :: held 2.642s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-9503b9bb-bc57-43d8-a586-197ddca42b66" released by "delete_snapshot" :: held 2.684s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (a39c93de-2425-4bb9-9fc5-d64c85026fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c176782f-a885-44c9-aa6b-63e2328da796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c176782f-a885-44c9-aa6b-63e2328da796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982679204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f48440-c8c1-4b2f-921d-3ab7cd250bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:32Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20961f0-d389-4ace-b48d-ebf8aa38202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20961f0-d389-4ace-b48d-ebf8aa38202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29c51d2-5a20-4c16-9b47-580e0c553d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29c51d2-5a20-4c16-9b47-580e0c553d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f48440-c8c1-4b2f-921d-3ab7cd250bec', 'volume_name': 'volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e7198b-7bf1-4707-94b2-59905bad956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e7198b-7bf1-4707-94b2-59905bad956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c9be64-1514-4f0a-ab15-94f58b720e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:32 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Volume 18f48440-c8c1-4b2f-921d-3ab7cd250bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec', 'volume_size': 1}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982679204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f48440-c8c1-4b2f-921d-3ab7cd250bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82b613fa4c643a086a01f28ca1c6a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:32Z,use_quota=True,user_id='7b228613bd0f487995da68c666525c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Creating volume 18f48440-c8c1-4b2f-921d-3ab7cd250bec {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:32 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:32 devstack sudo[102703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec 1073741824
Jul 23 03:28:32 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['8ba35fda-2f41-4e4e-be2d-4ace8d914e3d', '1495afec-8647-4c99-bac3-493793c7a5bb', '015b9d87-4b0d-4432-917b-ac265c265801', 'd5a05a9c-0ce0-483a-a057-1de5a213e2bd'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Delete snapshot completed successfully.
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8f5c8a3f-e94a-44f8-bb88-7b19582b9774 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-1f0cc7e2-f3dd-4e7f-9c15-11030cd4f3b7-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-9503b9bb-bc57-43d8-a586-197ddca42b66-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-9503b9bb-bc57-43d8-a586-197ddca42b66-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-9503b9bb-bc57-43d8-a586-197ddca42b66" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-9503b9bb-bc57-43d8-a586-197ddca42b66" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e020935-bacf-4375-983b-2cbb8cffdc35]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:33 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec 1073741824" returned: 0 in 0.665s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:33 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec
Jul 23 03:28:33 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:33 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:33 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:33 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c9be64-1514-4f0a-ab15-94f58b720e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c2fc8a-bba2-425e-ae28-964440afe1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Volume volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec (18f48440-c8c1-4b2f-921d-3ab7cd250bec): created successfully
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c2fc8a-bba2-425e-ae28-964440afe1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Flow 'volume_create_manager' (a39c93de-2425-4bb9-9fc5-d64c85026fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:33 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0e763650-4a49-41d5-8f83-19a7d0bf91b1 tempest-ProjectReaderTests-1578691462 None] Created volume successfully.
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.449s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:33 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66
Jul 23 03:28:33 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:33 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9503b9bb-bc57-43d8-a586-197ddca42b66" returned: 0 in 0.285s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-9503b9bb-bc57-43d8-a586-197ddca42b66" released by "delete_volume" :: held 0.820s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:33 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['b11e0ef4-edc1-4da9-ba27-50f1679b66f8', '5299fbab-d5ee-4deb-90c2-d3310cae93d5', '5d0a1f8f-cde0-4699-b8ea-7c286efdf45a', '1fb3c4c3-1210-4e8a-90fa-d86becc85359'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:34 devstack sudo[102732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:34 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "cinder-quobyte-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:34 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Deleted volume successfully.
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" acquired by "delete_volume" :: waited 0.039s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3b725267-9874-488d-9b6a-aff3f4e62331 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-9503b9bb-bc57-43d8-a586-197ddca42b66-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[04548104-5d3b-4962-93f9-0efb47645652]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-18f48440-c8c1-4b2f-921d-3ab7cd250bec-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Lock "cinder-18f48440-c8c1-4b2f-921d-3ab7cd250bec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:34 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd
Jul 23 03:28:34 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "cinder-quobyte-18f48440-c8c1-4b2f-921d-3ab7cd250bec" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-18f48440-c8c1-4b2f-921d-3ab7cd250bec" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61b3d73-470c-44fb-95de-af70916737ba]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:35 devstack sudo[102764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec
Jul 23 03:28:35 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:35 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" returned: 0 in 0.584s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:35 devstack sudo[102770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd
Jul 23 03:28:35 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Flow 'volume_create_manager' (985e5d28-fc01-4c48-bbbf-07331d3b9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09cbf7e-a475-45bc-8477-67be2671c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09cbf7e-a475-45bc-8477-67be2671c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1545616118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacadd43-e70d-4afd-9514-ccc3cf122eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61226ede454453690498373b5abc0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:35Z,use_quota=True,user_id='878ddc637df34d0290265014b9e372ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584a622b-d4d7-490c-929a-2a4ce028e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584a622b-d4d7-490c-929a-2a4ce028e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229ec03f-6716-4b1a-9e61-33725c0a1386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229ec03f-6716-4b1a-9e61-33725c0a1386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cacadd43-e70d-4afd-9514-ccc3cf122eab', 'volume_name': 'volume-cacadd43-e70d-4afd-9514-ccc3cf122eab', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6dc133-06ac-434e-9410-415fcead0e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6dc133-06ac-434e-9410-415fcead0e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f915d6c-a555-4558-9f16-6de296326e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:35 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Volume cacadd43-e70d-4afd-9514-ccc3cf122eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cacadd43-e70d-4afd-9514-ccc3cf122eab', 'volume_size': 1}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1545616118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacadd43-e70d-4afd-9514-ccc3cf122eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61226ede454453690498373b5abc0b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:35Z,use_quota=True,user_id='878ddc637df34d0290265014b9e372ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Creating volume cacadd43-e70d-4afd-9514-ccc3cf122eab {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:35 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:35 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec" returned: 0 in 0.551s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:35 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab 1073741824
Jul 23 03:28:35 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:35 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec
Jul 23 03:28:35 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:35 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" returned: 0 in 0.350s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-quobyte-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd" released by "delete_volume" :: held 1.090s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Created reservations ['52817faf-fb67-44e4-b955-4fea2feada8b', '9c40e62c-b5e8-4937-9ecb-8b6eb0c45617', '0d64b598-0f35-4601-b2e1-4539e52d834a', 'd54f5f41-164b-4b2c-9b37-9bef5074f35b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:35 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-18f48440-c8c1-4b2f-921d-3ab7cd250bec" returned: 0 in 0.321s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Lock "cinder-quobyte-18f48440-c8c1-4b2f-921d-3ab7cd250bec" released by "delete_volume" :: held 0.957s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:35 devstack sudo[102786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:35 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:35 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Created reservations ['063d5b57-a2bb-49a0-9d30-989c82568058', 'f0c20924-59ef-48c5-871d-f9d19c905f7e', 'ed5d8eed-a53d-40c2-8a21-cf5581db16c3', '43975b8b-3b86-480d-a972-95bf63130dbd'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:36 devstack sudo[102789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:36 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:36 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab 1073741824" returned: 0 in 0.685s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:36 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab
Jul 23 03:28:36 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:36 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.303s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Deleted volume successfully.
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-89bb88bb-4f87-4204-9442-b0bd8eccad71 tempest-VolumesSnapshotTestJSON-871571642 None] Lock "cinder-f00d08db-f39a-46d2-a1c0-b8fd801dd0cd-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:36 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.265s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Deleted volume successfully.
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f554b6ac-657c-42d8-b648-445d66001530 tempest-ProjectReaderTests-1578691462 None] Lock "cinder-18f48440-c8c1-4b2f-921d-3ab7cd250bec-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:36 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab" returned: 0 in 0.281s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f915d6c-a555-4558-9f16-6de296326e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacadd43-e70d-4afd-9514-ccc3cf122eab', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65d4889-94e9-440d-ab08-a33fc2e33254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Volume volume-cacadd43-e70d-4afd-9514-ccc3cf122eab (cacadd43-e70d-4afd-9514-ccc3cf122eab): created successfully
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65d4889-94e9-440d-ab08-a33fc2e33254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Flow 'volume_create_manager' (985e5d28-fc01-4c48-bbbf-07331d3b9eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5531d9da-d690-4342-97a9-d9553ad742e0 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Created volume successfully.
Jul 23 03:28:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-755bb012-d92b-4897-aaff-3ad43c71f2e5 req-7c66885e-a094-49e9-93b7-105d7f950d4a tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-755bb012-d92b-4897-aaff-3ad43c71f2e5 req-7c66885e-a094-49e9-93b7-105d7f950d4a tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-755bb012-d92b-4897-aaff-3ad43c71f2e5 req-7c66885e-a094-49e9-93b7-105d7f950d4a tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-755bb012-d92b-4897-aaff-3ad43c71f2e5 req-7c66885e-a094-49e9-93b7-105d7f950d4a tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-cacadd43-e70d-4afd-9514-ccc3cf122eab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2edb6603-93b0-495b-91d7-3b13ed70dc3e', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:28:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-755bb012-d92b-4897-aaff-3ad43c71f2e5 req-7c66885e-a094-49e9-93b7-105d7f950d4a tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] attachment_update completed successfully.
Jul 23 03:28:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-dbafb146-bd50-43d9-9fea-d46c34ebaa4d req-68a3b026-0ffd-4daf-9e39-81b3e2727f1b tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Terminate volume connection completed successfully.
Jul 23 03:28:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-dbafb146-bd50-43d9-9fea-d46c34ebaa4d req-68a3b026-0ffd-4daf-9e39-81b3e2727f1b tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Deleting attachment 2edb6603-93b0-495b-91d7-3b13ed70dc3e. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Acquiring lock "cinder-cacadd43-e70d-4afd-9514-ccc3cf122eab-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "cinder-cacadd43-e70d-4afd-9514-ccc3cf122eab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Acquiring lock "cinder-quobyte-cacadd43-e70d-4afd-9514-ccc3cf122eab" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "cinder-quobyte-cacadd43-e70d-4afd-9514-ccc3cf122eab" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f707678-46c9-4c19-969f-ab97333f2d27]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:43 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab
Jul 23 03:28:43 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:43 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab" returned: 0 in 0.432s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:43 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab
Jul 23 03:28:43 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:43 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cacadd43-e70d-4afd-9514-ccc3cf122eab" returned: 0 in 0.293s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "cinder-quobyte-cacadd43-e70d-4afd-9514-ccc3cf122eab" released by "delete_volume" :: held 0.772s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Created reservations ['17dc053f-212d-4738-b775-59fb2b627780', '776fe99b-94d7-414d-a31d-31ec7971334d', '3118973f-67f7-4839-b7d3-cf34133446b1', 'e3750508-a3e3-46c3-b4d2-214eee59e5e0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:44 devstack sudo[103233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:44 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:44 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Deleted volume successfully.
Jul 23 03:28:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-219b13fe-4188-4ad7-9bb9-3e0e3bea1852 tempest-TestServerVolumeAttachScenarioOldVersion-1093841657 None] Lock "cinder-cacadd43-e70d-4afd-9514-ccc3cf122eab-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Flow 'volume_create_manager' (7989dcb0-31da-4fd7-95cc-ed2e4116a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234f80e-d0f6-46c7-9053-bd5256445b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234f80e-d0f6-46c7-9053-bd5256445b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1873521604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b67a82f-97ae-4dbc-9e45-b99b8d100a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2de514d506941d1a4fd6263279a4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:49Z,use_quota=True,user_id='c4330e4599114916a7b3f832221d1974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe1e5ec-aa54-437c-9c88-1ebb75066850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe1e5ec-aa54-437c-9c88-1ebb75066850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08a6050-6cf8-4c5d-bb2a-fa4b05ea463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08a6050-6cf8-4c5d-bb2a-fa4b05ea463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b67a82f-97ae-4dbc-9e45-b99b8d100a16', 'volume_name': 'volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16', 'volume_size': 2}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4658a5-cdee-4d8a-a4af-93feeedc41f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4658a5-cdee-4d8a-a4af-93feeedc41f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d78c89-e761-4682-a7c1-c4e85ddb135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:49 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Volume 6b67a82f-97ae-4dbc-9e45-b99b8d100a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16', 'volume_size': 2}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1873521604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b67a82f-97ae-4dbc-9e45-b99b8d100a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2de514d506941d1a4fd6263279a4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:49Z,use_quota=True,user_id='c4330e4599114916a7b3f832221d1974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Creating volume 6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:49 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 2147483648 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:49 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 2147483648
Jul 23 03:28:49 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:50 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 2147483648" returned: 0 in 0.616s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:50 devstack sudo[103277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16
Jul 23 03:28:50 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:50 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" returned: 0 in 0.289s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d78c89-e761-4682-a7c1-c4e85ddb135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16', 'volume_size': 2}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c885a35-0a1b-4c19-abe0-5141b151dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:50 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Volume volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 (6b67a82f-97ae-4dbc-9e45-b99b8d100a16): created successfully
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c885a35-0a1b-4c19-abe0-5141b151dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Flow 'volume_create_manager' (7989dcb0-31da-4fd7-95cc-ed2e4116a495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-05e17f9b-4b37-41d6-9806-a603d7c2fa72 tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Created volume successfully.
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Flow 'volume_create_manager' (9794dede-cf01-4b25-9832-6a07b0eaf126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4b8e84-bb3f-4c6f-91f4-77b8aeece244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4b8e84-bb3f-4c6f-91f4-77b8aeece244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-536454492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01056d7c-d41b-4626-8b96-43ac77318a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763a8e94f9e48919085cdb891825df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:51Z,use_quota=True,user_id='80ce7f9b7b1f4737baf2bbb0dae69010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3eac03-e075-49ef-911e-79cd7636a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3eac03-e075-49ef-911e-79cd7636a60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ef6233-75a0-40cc-ad0e-0206ea573c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ef6233-75a0-40cc-ad0e-0206ea573c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01056d7c-d41b-4626-8b96-43ac77318a59', 'volume_name': 'volume-01056d7c-d41b-4626-8b96-43ac77318a59', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f3c8b30>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985eb02-e771-4a30-af35-e76bb9cf4ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985eb02-e771-4a30-af35-e76bb9cf4ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da964c10-7226-4ccf-8895-3020a93ea638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:51 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Volume 01056d7c-d41b-4626-8b96-43ac77318a59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01056d7c-d41b-4626-8b96-43ac77318a59', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f3c8b30>}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Trying to clone 01056d7c-d41b-4626-8b96-43ac77318a59 from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Creating offline snapshot e0fc1fac-7220-40e3-a011-e0fb67a5f781 of volume 6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fd2d5-e5e4-4a13-8918-8817808766c3]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:51 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16
Jul 23 03:28:51 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:28:52 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Image download 20.69 MB at 20.69 MB/s
Jul 23 03:28:52 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" returned: 0 in 0.476s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 2G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794cd09-6a58-46ed-924b-224cff97aada]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:52 devstack sudo[103287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 2G
Jul 23 03:28:52 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:52 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD
Jul 23 03:28:52 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:52 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d is fetched for user 80ce7f9b7b1f4737baf2bbb0dae69010. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[82329a5a-793c-4e86-9121-fe0248c1bc5e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:52 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 2G" returned: 0 in 0.560s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:52 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781
Jul 23 03:28:52 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:52 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD
Jul 23 03:28:52 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:53 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:53 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781" returned: 0 in 0.327s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:53 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 is being set with open permissions: ugo+rw
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:53 devstack sudo[103307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781
Jul 23 03:28:53 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:53 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781" returned: 0 in 0.262s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:53 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info
Jul 23 03:28:53 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:53 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info" returned: 0 in 0.269s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:53 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info is being set with open permissions: ugo+rw
Jul 23 03:28:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:53 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info
Jul 23 03:28:53 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:54 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.info" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-536454492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01056d7c-d41b-4626-8b96-43ac77318a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763a8e94f9e48919085cdb891825df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:51Z,use_quota=True,user_id='80ce7f9b7b1f4737baf2bbb0dae69010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Creating volume 01056d7c-d41b-4626-8b96-43ac77318a59 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:28:54 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:54 devstack sudo[103317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 1073741824
Jul 23 03:28:54 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-00634542-509e-42f4-8621-33099fd9573d tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Create snapshot completed successfully
Jul 23 03:28:54 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 1073741824" returned: 0 in 0.426s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:54 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59
Jul 23 03:28:54 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:54 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59" returned: 0 in 0.288s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Attempting download of d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume 01056d7c-d41b-4626-8b96-43ac77318a59. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d411f81b-bffc-4baa-a99f-9c25f05b2cb8]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "cinder-e0fc1fac-7220-40e3-a011-e0fb67a5f781-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-e0fc1fac-7220-40e3-a011-e0fb67a5f781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:55 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx
Jul 23 03:28:55 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "cinder-quobyte-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-quobyte-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "cinder-quobyte-e0fc1fac-7220-40e3-a011-e0fb67a5f781" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-quobyte-e0fc1fac-7220-40e3-a011-e0fb67a5f781" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Deleting offline snapshot e0fc1fac-7220-40e3-a011-e0fb67a5f781 of volume 6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] snapshot_file for this snap is: volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f599e6-764d-4bd6-a55b-4a6aebabecba]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:55 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781
Jul 23 03:28:55 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:55 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx" returned: 0 in 0.411s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:55 devstack sudo[103334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx
Jul 23 03:28:55 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:55 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781" returned: 0 in 0.440s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd69a2f-3c5f-401f-bb49-5e211a5a34d4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:55 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx" returned: 1 in 0.353s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_s6hhockx' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf015c-658b-41a1-80c4-926a2301cfca]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:55 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16
Jul 23 03:28:55 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:55 devstack sudo[103342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD
Jul 23 03:28:55 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:56 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" returned: 0 in 0.397s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:56 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] d528e14a-f1e8-46f0-b9e4-aded7536eb2d was qcow2, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:28:56 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781
Jul 23 03:28:56 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:56 devstack sudo[103353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59
Jul 23 03:28:56 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:56 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781" returned: 0 in 0.382s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:56 devstack sudo[103361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781
Jul 23 03:28:56 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:56 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16.e0fc1fac-7220-40e3-a011-e0fb67a5f781" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-quobyte-e0fc1fac-7220-40e3-a011-e0fb67a5f781" released by "_delete_snapshot" :: held 1.730s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-quobyte-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" released by "delete_snapshot" :: held 1.757s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:56 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Created reservations ['5f89f5cf-0656-4426-95a3-1b870bfb4214', '3c09ce0c-45fb-41d9-a98a-fdc1ca8c9811', 'a8b28915-cda2-4891-a95b-75cebb8fecb0', 'a597c399-b634-4cbb-9829-6588f4b69608'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:56 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Delete snapshot completed successfully.
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d44eba2e-e98c-43d8-af3d-051bff54a1eb tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-e0fc1fac-7220-40e3-a011-e0fb67a5f781-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "cinder-6b67a82f-97ae-4dbc-9e45-b99b8d100a16-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-6b67a82f-97ae-4dbc-9e45-b99b8d100a16-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "cinder-quobyte-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-quobyte-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e3861c-588b-4252-8739-d46404c6c5f9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:57 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16
Jul 23 03:28:57 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:57 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" returned: 0 in 0.510s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:57 devstack sudo[103373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16
Jul 23 03:28:57 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:58 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59" returned: 0 in 2.125s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d528e14a-f1e8-46f0-b9e4-aded7536eb2d_c2rskisjdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:28:58 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Converted 112.00 MB image at 52.65 MB/s
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:58 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 1G
Jul 23 03:28:58 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:58 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-quobyte-6b67a82f-97ae-4dbc-9e45-b99b8d100a16" released by "delete_volume" :: held 0.867s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Created reservations ['50cc35b4-766c-4b69-bc0a-75ab717aef28', '717c4f2f-f4b8-4e7f-b25f-1b81716c1acd', '7eaa6427-ae19-4ba2-b29e-aae02866ef5f', '76273517-4929-4b9c-b9e3-b00b68b09bad'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:58 devstack sudo[103378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:58 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:58 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 1G" returned: 0 in 0.419s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Downloaded image d528e14a-f1e8-46f0-b9e4-aded7536eb2d ((None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}])) to volume 01056d7c-d41b-4626-8b96-43ac77318a59 successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Temporary image d528e14a-f1e8-46f0-b9e4-aded7536eb2d for user 80ce7f9b7b1f4737baf2bbb0dae69010 is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Marking volume 01056d7c-d41b-4626-8b96-43ac77318a59 as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Copying metadata from image d528e14a-f1e8-46f0-b9e4-aded7536eb2d to 01056d7c-d41b-4626-8b96-43ac77318a59. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Creating volume glance metadata for volume 01056d7c-d41b-4626-8b96-43ac77318a59 backed by image d528e14a-f1e8-46f0-b9e4-aded7536eb2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:28:58 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Deleted volume successfully.
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b5dd87f3-1ef3-4d9a-8fcf-df8a3da1346e tempest-VolumesSnapshotNegativeTestJSON-871522279 None] Lock "cinder-6b67a82f-97ae-4dbc-9e45-b99b8d100a16-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da964c10-7226-4ccf-8895-3020a93ea638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01056d7c-d41b-4626-8b96-43ac77318a59', 'volume_size': 1, 'image_id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '22ee31ff12e54e67ae355c7620ef5010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd528e14a-f1e8-46f0-b9e4-aded7536eb2d', 'created_at': datetime.datetime(2026, 7, 23, 1, 10, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 10, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d528e14a-f1e8-46f0-b9e4-aded7536eb2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f3c8b30>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee0f43f-8f1b-4357-92fb-7124b0bf84ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:28:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Volume volume-01056d7c-d41b-4626-8b96-43ac77318a59 (01056d7c-d41b-4626-8b96-43ac77318a59): created successfully
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee0f43f-8f1b-4357-92fb-7124b0bf84ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:28:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Flow 'volume_create_manager' (9794dede-cf01-4b25-9832-6a07b0eaf126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:28:58 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:28:58 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:28:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d1cf08a4-2b25-403d-bc2f-c790b4e7654d tempest-TestShelveInstance-208428054 None] Created volume successfully.
Jul 23 03:28:59 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Jul 23 03:28:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.313s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:28:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:28:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:28:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:28:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:29:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-92fb33a7-c553-437e-896a-b4aea2497a7a req-b242542c-a852-49a2-949a-63ce01dbde9f tempest-TestShelveInstance-208428054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-92fb33a7-c553-437e-896a-b4aea2497a7a req-b242542c-a852-49a2-949a-63ce01dbde9f tempest-TestShelveInstance-208428054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-92fb33a7-c553-437e-896a-b4aea2497a7a req-b242542c-a852-49a2-949a-63ce01dbde9f tempest-TestShelveInstance-208428054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-92fb33a7-c553-437e-896a-b4aea2497a7a req-b242542c-a852-49a2-949a-63ce01dbde9f tempest-TestShelveInstance-208428054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-01056d7c-d41b-4626-8b96-43ac77318a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02b231ab-9127-49b3-885f-81356bc56a57', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:29:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-92fb33a7-c553-437e-896a-b4aea2497a7a req-b242542c-a852-49a2-949a-63ce01dbde9f tempest-TestShelveInstance-208428054 None] attachment_update completed successfully.
Jul 23 03:29:15 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=117,cinder:INSERT=38,cinder:UPDATE=138,cinder:DELETE=8 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:29:15 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=109,cinder:INSERT=37,cinder:UPDATE=123,cinder:DELETE=13 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Flow 'volume_create_manager' (f4237a75-6239-4610-9ab7-c723998f478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57c9e1a-0b33-4064-aa7e-ef7f8bfd3323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57c9e1a-0b33-4064-aa7e-ef7f8bfd3323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-338068839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ea1efc-398b-4faa-aa4d-846c69cb1904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa23edb5a60b49cca9a6921b357a7523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:35Z,use_quota=True,user_id='0d8f2eb028034890a76fa09fe4884814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23014ee6-7a73-4825-b76c-9fa67010a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23014ee6-7a73-4825-b76c-9fa67010a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71581528-92d7-4f56-8fb2-4d427dde7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71581528-92d7-4f56-8fb2-4d427dde7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ea1efc-398b-4faa-aa4d-846c69cb1904', 'volume_name': 'volume-23ea1efc-398b-4faa-aa4d-846c69cb1904', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0208e23d-f411-43d7-9c0a-f740efe3635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0208e23d-f411-43d7-9c0a-f740efe3635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d7f5f-fedd-44ca-bb4d-1e054d96e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:35 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Volume 23ea1efc-398b-4faa-aa4d-846c69cb1904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ea1efc-398b-4faa-aa4d-846c69cb1904', 'volume_size': 1}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-338068839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ea1efc-398b-4faa-aa4d-846c69cb1904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa23edb5a60b49cca9a6921b357a7523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:35Z,use_quota=True,user_id='0d8f2eb028034890a76fa09fe4884814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Creating volume 23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:29:35 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:29:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:29:35 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 1073741824
Jul 23 03:29:35 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:29:36 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 1073741824" returned: 0 in 0.761s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:29:36 devstack sudo[103956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:29:36 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:29:36 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.466s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d7f5f-fedd-44ca-bb4d-1e054d96e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ea1efc-398b-4faa-aa4d-846c69cb1904', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3747ec73-bcbd-4ea1-ae76-28f04c6b3279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Volume volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 (23ea1efc-398b-4faa-aa4d-846c69cb1904): created successfully
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3747ec73-bcbd-4ea1-ae76-28f04c6b3279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Flow 'volume_create_manager' (f4237a75-6239-4610-9ab7-c723998f478d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:29:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f59a3f15-e278-4077-bafe-7697950bbd79 tempest-TestStampPattern-1344332890 None] Created volume successfully.
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Flow 'volume_create_manager' (4792cf4b-1bad-40e2-97fe-dded1b0dfbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc87b16-5247-4694-9d07-9b2717321da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc87b16-5247-4694-9d07-9b2717321da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1147302511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1ded55-5278-4b61-9f22-abc2cc543b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e81b0c091b94cf88984359c864d8b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:46Z,use_quota=True,user_id='f3b032dcd3864398bce3924fd179efe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18533f8-c4e3-4d4c-9351-a4643a91affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18533f8-c4e3-4d4c-9351-a4643a91affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbba27ea-8911-43cf-a220-aa9b4b017826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbba27ea-8911-43cf-a220-aa9b4b017826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1ded55-5278-4b61-9f22-abc2cc543b36', 'volume_name': 'volume-6b1ded55-5278-4b61-9f22-abc2cc543b36', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e719976a-9272-47b5-a792-7fc919de1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e719976a-9272-47b5-a792-7fc919de1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cd7381-07ee-4b70-833a-0616c49ad15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:46 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Volume 6b1ded55-5278-4b61-9f22-abc2cc543b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1ded55-5278-4b61-9f22-abc2cc543b36', 'volume_size': 1}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1147302511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1ded55-5278-4b61-9f22-abc2cc543b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e81b0c091b94cf88984359c864d8b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:46Z,use_quota=True,user_id='f3b032dcd3864398bce3924fd179efe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Creating volume 6b1ded55-5278-4b61-9f22-abc2cc543b36 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:29:46 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:29:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:29:46 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 1073741824
Jul 23 03:29:46 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:29:47 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 1073741824" returned: 0 in 0.592s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:29:47 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36
Jul 23 03:29:47 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:29:47 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cd7381-07ee-4b70-833a-0616c49ad15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1ded55-5278-4b61-9f22-abc2cc543b36', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1574dd3a-b62b-4059-aefc-540545a7a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:29:47 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Volume volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 (6b1ded55-5278-4b61-9f22-abc2cc543b36): created successfully
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1574dd3a-b62b-4059-aefc-540545a7a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:29:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Flow 'volume_create_manager' (4792cf4b-1bad-40e2-97fe-dded1b0dfbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:29:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f0758dab-dccc-4bb8-b5c2-b85fe1415809 tempest-TestMinimumBasicScenario-1153586618 None] Created volume successfully.
Jul 23 03:29:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9d036350-c5b2-426a-bd46-52e0d6be241c req-e0f3c472-7209-4f8c-bee3-12fdc539573b tempest-TestMinimumBasicScenario-1153586618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9d036350-c5b2-426a-bd46-52e0d6be241c req-e0f3c472-7209-4f8c-bee3-12fdc539573b tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-9d036350-c5b2-426a-bd46-52e0d6be241c req-e0f3c472-7209-4f8c-bee3-12fdc539573b tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-9d036350-c5b2-426a-bd46-52e0d6be241c req-e0f3c472-7209-4f8c-bee3-12fdc539573b tempest-TestMinimumBasicScenario-1153586618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-6b1ded55-5278-4b61-9f22-abc2cc543b36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36fcff87-0a05-4de8-a991-3c30f06f3f87', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:29:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-9d036350-c5b2-426a-bd46-52e0d6be241c req-e0f3c472-7209-4f8c-bee3-12fdc539573b tempest-TestMinimumBasicScenario-1153586618 None] attachment_update completed successfully.
Jul 23 03:29:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-b23ac494-3094-49ec-91f2-a6a482faa282 req-df704414-2743-491a-8f9d-3349012ba5b9 tempest-TestShelveInstance-208428054 None] Terminate volume connection completed successfully.
Jul 23 03:29:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-b23ac494-3094-49ec-91f2-a6a482faa282 req-df704414-2743-491a-8f9d-3349012ba5b9 tempest-TestShelveInstance-208428054 None] Deleting attachment 02b231ab-9127-49b3-885f-81356bc56a57. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:29:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-515fdd3e-e6ad-47fa-a6c5-05b556922a09 req-fbc3aec2-f663-4b07-96c6-67ca06e1e658 tempest-TestShelveInstance-208428054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-515fdd3e-e6ad-47fa-a6c5-05b556922a09 req-fbc3aec2-f663-4b07-96c6-67ca06e1e658 tempest-TestShelveInstance-208428054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-515fdd3e-e6ad-47fa-a6c5-05b556922a09 req-fbc3aec2-f663-4b07-96c6-67ca06e1e658 tempest-TestShelveInstance-208428054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-515fdd3e-e6ad-47fa-a6c5-05b556922a09 req-fbc3aec2-f663-4b07-96c6-67ca06e1e658 tempest-TestShelveInstance-208428054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-01056d7c-d41b-4626-8b96-43ac77318a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '199a35a1-a580-4f6b-9557-8292bee90ff3', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:29:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-515fdd3e-e6ad-47fa-a6c5-05b556922a09 req-fbc3aec2-f663-4b07-96c6-67ca06e1e658 tempest-TestShelveInstance-208428054 None] attachment_update completed successfully.
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:29:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:29:58 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:29:58 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:29:59 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Jul 23 03:29:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.446s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:29:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:29:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:29:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:29:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:30:07 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=10,cinder:SELECT=14,cinder:INSERT=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:30:07 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=22,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:30:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-707cdd84-17a0-475d-af3c-05a59a5ab6fa req-414029ac-c092-42dd-afe8-04b0fef88e05 tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-707cdd84-17a0-475d-af3c-05a59a5ab6fa req-414029ac-c092-42dd-afe8-04b0fef88e05 tempest-TestStampPattern-1344332890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-707cdd84-17a0-475d-af3c-05a59a5ab6fa req-414029ac-c092-42dd-afe8-04b0fef88e05 tempest-TestStampPattern-1344332890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-707cdd84-17a0-475d-af3c-05a59a5ab6fa req-414029ac-c092-42dd-afe8-04b0fef88e05 tempest-TestStampPattern-1344332890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-23ea1efc-398b-4faa-aa4d-846c69cb1904', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e389d69-301f-444e-be75-265750cb47fb', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:30:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-707cdd84-17a0-475d-af3c-05a59a5ab6fa req-414029ac-c092-42dd-afe8-04b0fef88e05 tempest-TestStampPattern-1344332890 None] attachment_update completed successfully.
Jul 23 03:30:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-b90f42a4-2c2a-4500-8a75-0e27ae3b3992 req-25e16f12-b4c7-411f-9a90-fc57ea4cd100 tempest-TestStampPattern-1344332890 None] Terminate volume connection completed successfully.
Jul 23 03:30:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-b90f42a4-2c2a-4500-8a75-0e27ae3b3992 req-25e16f12-b4c7-411f-9a90-fc57ea4cd100 tempest-TestStampPattern-1344332890 None] Deleting attachment 2e389d69-301f-444e-be75-265750cb47fb. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Creating offline snapshot 27b6f648-7321-46d6-bcd5-21b953176d40 of volume 23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe40298-eccc-41e8-9a44-83ae82add69c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:19 devstack sudo[104522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:30:19 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:19 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.378s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:19 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 1G
Jul 23 03:30:19 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:20 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 1G" returned: 0 in 0.430s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:20 devstack sudo[104532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40
Jul 23 03:30:20 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:20 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40" returned: 0 in 0.316s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:20 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 is being set with open permissions: ugo+rw
Jul 23 03:30:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:20 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40
Jul 23 03:30:20 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:20 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:20 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info
Jul 23 03:30:20 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:21 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info" returned: 0 in 0.278s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:21 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info is being set with open permissions: ugo+rw
Jul 23 03:30:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:21 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info
Jul 23 03:30:21 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:21 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.info" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:21 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-23cc8795-3257-4721-a7c3-2814bfc05cca tempest-TestStampPattern-1344332890 None] Create snapshot completed successfully
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Flow 'volume_create_manager' (173786e9-9a31-4f7f-aaef-1a30132be2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9aa772-33f2-4d80-bca4-0c874439bd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9aa772-33f2-4d80-bca4-0c874439bd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1467000608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d296c332-4470-48b8-a431-8e909e09b5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa23edb5a60b49cca9a6921b357a7523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27b6f648-7321-46d6-bcd5-21b953176d40,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:29Z,use_quota=True,user_id='0d8f2eb028034890a76fa09fe4884814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163301a3-338b-4156-a49a-f99b285e2a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163301a3-338b-4156-a49a-f99b285e2a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe81a73-5fde-468e-8114-5178ebb2b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe81a73-5fde-468e-8114-5178ebb2b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd296c332-4470-48b8-a431-8e909e09b5a4', 'volume_name': 'volume-d296c332-4470-48b8-a431-8e909e09b5a4', 'volume_size': 1, 'snapshot_id': '27b6f648-7321-46d6-bcd5-21b953176d40'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc08e31-4fd5-4781-91c3-655c1661f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc08e31-4fd5-4781-91c3-655c1661f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323d1c51-5f7e-4cda-8730-99f1f5e0717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:29 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Volume d296c332-4470-48b8-a431-8e909e09b5a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d296c332-4470-48b8-a431-8e909e09b5a4', 'volume_size': 1, 'snapshot_id': '27b6f648-7321-46d6-bcd5-21b953176d40'}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-quobyte-27b6f648-7321-46d6-bcd5-21b953176d40-d296c332-4470-48b8-a431-8e909e09b5a4" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-27b6f648-7321-46d6-bcd5-21b953176d40-d296c332-4470-48b8-a431-8e909e09b5a4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Creating volume d296c332-4470-48b8-a431-8e909e09b5a4 from snapshot 27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-quobyte-d296c332-4470-48b8-a431-8e909e09b5a4" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-d296c332-4470-48b8-a431-8e909e09b5a4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] snapshot: 27b6f648-7321-46d6-bcd5-21b953176d40, volume: d296c332-4470-48b8-a431-8e909e09b5a4,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c0b1b-3c56-40bd-bf45-7e5ba5552273]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:29 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40
Jul 23 03:30:29 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:29 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40" returned: 0 in 0.398s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23ea1efc-398b-4faa-aa4d-846c69cb1904(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1e2033-48a8-4d58-bfd4-2dfbea7e95f7]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:30:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:30 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:30:30 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:30 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.425s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:30 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:30:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:30 devstack sudo[104594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4
Jul 23 03:30:30 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:36 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4" returned: 0 in 5.767s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:36 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad0514-7cab-4510-b692-ea54d09add19]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:30:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:36 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:30:36 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:36 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.724s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:36 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:30:36 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Converted 1024.00 MB image at 177.54 MB/s
Jul 23 03:30:36 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 is being set with open permissions: ugo+rw
Jul 23 03:30:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:36 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4
Jul 23 03:30:36 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:37 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-d296c332-4470-48b8-a431-8e909e09b5a4" released by "_copy_volume_from_snapshot" :: held 7.701s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-27b6f648-7321-46d6-bcd5-21b953176d40-d296c332-4470-48b8-a431-8e909e09b5a4" released by "_create_volume_from_snapshot" :: held 7.733s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.748s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323d1c51-5f7e-4cda-8730-99f1f5e0717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d296c332-4470-48b8-a431-8e909e09b5a4', 'volume_size': 1, 'snapshot_id': '27b6f648-7321-46d6-bcd5-21b953176d40'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44287e4d-f85f-4f4c-a2c6-5f8522036202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:37 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Volume volume-d296c332-4470-48b8-a431-8e909e09b5a4 (d296c332-4470-48b8-a431-8e909e09b5a4): created successfully
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44287e4d-f85f-4f4c-a2c6-5f8522036202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Flow 'volume_create_manager' (173786e9-9a31-4f7f-aaef-1a30132be2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-46a7ae68-fd3c-4bc8-94b6-0c10afc5af7a tempest-TestStampPattern-1344332890 None] Created volume successfully.
Jul 23 03:30:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-bb39c6fe-0026-46dc-a758-47876331e16e req-ba8bcfa5-0bb5-4dd9-abf8-520b237cf059 tempest-TestShelveInstance-208428054 None] Terminate volume connection completed successfully.
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-bb39c6fe-0026-46dc-a758-47876331e16e req-ba8bcfa5-0bb5-4dd9-abf8-520b237cf059 tempest-TestShelveInstance-208428054 None] Deleting attachment 199a35a1-a580-4f6b-9557-8292bee90ff3. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Acquiring lock "cinder-01056d7c-d41b-4626-8b96-43ac77318a59-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Lock "cinder-01056d7c-d41b-4626-8b96-43ac77318a59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Acquiring lock "cinder-quobyte-01056d7c-d41b-4626-8b96-43ac77318a59" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Lock "cinder-quobyte-01056d7c-d41b-4626-8b96-43ac77318a59" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8c963-d6c3-4c90-928b-c3c0eddcca49]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:30:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:43 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59
Jul 23 03:30:43 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:43 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59" returned: 0 in 0.530s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:43 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59
Jul 23 03:30:43 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:43 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-01056d7c-d41b-4626-8b96-43ac77318a59" returned: 0 in 0.334s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Lock "cinder-quobyte-01056d7c-d41b-4626-8b96-43ac77318a59" released by "delete_volume" :: held 0.936s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:30:43 devstack cinder-volume[88344]: DEBUG cinder.quota [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Created reservations ['1697a4e1-f30b-40b2-ac34-96a93337c581', 'fb4c2921-3dd6-40d4-a4a0-afbe4e790dfe', 'c321ee54-cc46-41d9-8e32-497170194a02', 'dc8aa6ef-3d75-41a0-9888-008122982572'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:44 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:30:44 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:44 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.334s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG cinder.manager [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:30:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Deleted volume successfully.
Jul 23 03:30:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [req-bb39c6fe-0026-46dc-a758-47876331e16e req-557bf03a-6aca-4729-8edd-6bfa3e5d1eb9 tempest-TestShelveInstance-208428054 None] Lock "cinder-01056d7c-d41b-4626-8b96-43ac77318a59-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:30:52 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-0865231b-5a82-49d8-b84c-0daefcc622ba req-7f51a6f9-0b6c-402e-ba07-f5e587e622d4 tempest-TestMinimumBasicScenario-1153586618 None] Terminate volume connection completed successfully.
Jul 23 03:30:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-0865231b-5a82-49d8-b84c-0daefcc622ba req-7f51a6f9-0b6c-402e-ba07-f5e587e622d4 tempest-TestMinimumBasicScenario-1153586618 None] Deleting attachment 36fcff87-0a05-4de8-a991-3c30f06f3f87. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Acquiring lock "cinder-6b1ded55-5278-4b61-9f22-abc2cc543b36-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Lock "cinder-6b1ded55-5278-4b61-9f22-abc2cc543b36-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Acquiring lock "cinder-quobyte-6b1ded55-5278-4b61-9f22-abc2cc543b36" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Lock "cinder-quobyte-6b1ded55-5278-4b61-9f22-abc2cc543b36" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1bdbb-0de3-4804-bd48-d65a1d207d7b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:53 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36
Jul 23 03:30:53 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:53 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36" returned: 0 in 0.356s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:53 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36
Jul 23 03:30:53 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:53 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b1ded55-5278-4b61-9f22-abc2cc543b36" returned: 0 in 0.263s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Lock "cinder-quobyte-6b1ded55-5278-4b61-9f22-abc2cc543b36" released by "delete_volume" :: held 0.666s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Created reservations ['ec4fde82-2a65-453b-add4-5ac025f80844', 'af67b353-1399-4876-b9ac-6fc9e9835a59', '3db0bb7c-9b99-47ec-97b8-2c3b8f1e0b89', '5fe5476d-96ed-4310-92af-c3f53136c2e6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:54 devstack sudo[104828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:30:54 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:54 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.252s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:30:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Deleted volume successfully.
Jul 23 03:30:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f855e7cc-aa39-4ca1-b3dd-8eea4d68d286 tempest-TestMinimumBasicScenario-1153586618 None] Lock "cinder-6b1ded55-5278-4b61-9f22-abc2cc543b36-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:30:55 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:30:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (d5a3a75a-a4b0-4752-82a0-7d3ab5736855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:55 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a662cad-98d6-4ecb-a8c1-218aec3dbd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a662cad-98d6-4ecb-a8c1-218aec3dbd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940020177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4d0087-b3bd-49b8-a0a2-c83328c69044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:56Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c506675-a19a-4494-833e-5ff32ec36e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c506675-a19a-4494-833e-5ff32ec36e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9968cb82-94f4-468f-aee9-c098c4969d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9968cb82-94f4-468f-aee9-c098c4969d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4d0087-b3bd-49b8-a0a2-c83328c69044', 'volume_name': 'volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2108c5c-557f-48ff-8ff3-c9cd4ac9dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2108c5c-557f-48ff-8ff3-c9cd4ac9dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8f17fc-ab06-43f8-9395-fceefa3def41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Volume 1a4d0087-b3bd-49b8-a0a2-c83328c69044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044', 'volume_size': 1}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940020177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4d0087-b3bd-49b8-a0a2-c83328c69044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:56Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Creating volume 1a4d0087-b3bd-49b8-a0a2-c83328c69044 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:30:56 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:56 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 1073741824
Jul 23 03:30:56 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (da83e614-06be-4bf1-a377-5c70368d0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814109e0-8243-40f5-a4d7-3bef4bbae7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814109e0-8243-40f5-a4d7-3bef4bbae7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149355948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aece1dc0-8343-477c-b292-ef1b1cc6e8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:56Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da36942b-ad57-4f0f-ad24-fa8d2330aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da36942b-ad57-4f0f-ad24-fa8d2330aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15a03f-8030-49c8-8f2f-8a45fb8a7bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15a03f-8030-49c8-8f2f-8a45fb8a7bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aece1dc0-8343-477c-b292-ef1b1cc6e8c6', 'volume_name': 'volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e71fda-47b4-4359-a546-881730257439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e71fda-47b4-4359-a546-881730257439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b968d997-93da-4802-8a1f-a6c3703d0238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:56 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Volume aece1dc0-8343-477c-b292-ef1b1cc6e8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6', 'volume_size': 1}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:56 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 1073741824" returned: 0 in 0.657s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:56 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044
Jul 23 03:30:56 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (5180e888-dd15-4117-abbe-7f03d5b526f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c2b6f9-ae82-45ba-9d45-c42c7821aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c2b6f9-ae82-45ba-9d45-c42c7821aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2032727472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe629a04-35a4-4aaa-9945-b8ade92ee92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:57Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8094e179-6fb5-415f-8b26-44931a6d1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8094e179-6fb5-415f-8b26-44931a6d1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397a89ad-8228-4c29-91ea-95d4d7482ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397a89ad-8228-4c29-91ea-95d4d7482ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe629a04-35a4-4aaa-9945-b8ade92ee92f', 'volume_name': 'volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ea44d7-9b61-4c6d-9305-651ab4fc1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ea44d7-9b61-4c6d-9305-651ab4fc1fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1e39e3-2595-4e3e-b8b3-a4ee812140c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Volume fe629a04-35a4-4aaa-9945-b8ade92ee92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f', 'volume_size': 1}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149355948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aece1dc0-8343-477c-b292-ef1b1cc6e8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:56Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Creating volume aece1dc0-8343-477c-b292-ef1b1cc6e8c6 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:30:57 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8f17fc-ab06-43f8-9395-fceefa3def41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c44322-a66e-4053-8686-7328b3da080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack sudo[104868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 1073741824
Jul 23 03:30:57 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:57 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Volume volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 (1a4d0087-b3bd-49b8-a0a2-c83328c69044): created successfully
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c44322-a66e-4053-8686-7328b3da080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (d5a3a75a-a4b0-4752-82a0-7d3ab5736855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e93055bd-f051-4d6c-aba8-b54c32d14404 tempest-CreateVolumesFromImageTest-644170370 None] Created volume successfully.
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (9299797f-bc10-4406-9e2e-f5258f5bd993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa8e6fa-17b8-4290-80eb-df977c8b6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa8e6fa-17b8-4290-80eb-df977c8b6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245623157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe8f324-d50d-489c-bd5e-9ce1e15be79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:57Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbe4fc4-a28f-476f-b5ba-26863cb50bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbe4fc4-a28f-476f-b5ba-26863cb50bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6a9d4b-50d0-4b39-b5a8-0e8118d052fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6a9d4b-50d0-4b39-b5a8-0e8118d052fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe8f324-d50d-489c-bd5e-9ce1e15be79a', 'volume_name': 'volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06050ed0-08d3-491b-83fd-69497bf04847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06050ed0-08d3-491b-83fd-69497bf04847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76edcebd-0b61-4982-a3a0-3b755e064d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:57 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Volume dbe8f324-d50d-489c-bd5e-9ce1e15be79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a', 'volume_size': 1}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:57 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 1073741824" returned: 0 in 0.635s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:57 devstack sudo[104874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6
Jul 23 03:30:57 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:57 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (8f7d7e26-3554-42df-9c08-df6bc0aac101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fafa70f-6e27-4b3c-a715-96df9c24b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fafa70f-6e27-4b3c-a715-96df9c24b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180815280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38a8a24-256b-466d-b0b2-19b6eba5622e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:58Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f1e378-2ed9-4faf-8d7d-867804751d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f1e378-2ed9-4faf-8d7d-867804751d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9223f0-054a-4843-94a4-9f06ba5f0831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9223f0-054a-4843-94a4-9f06ba5f0831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38a8a24-256b-466d-b0b2-19b6eba5622e', 'volume_name': 'volume-a38a8a24-256b-466d-b0b2-19b6eba5622e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37200655-9a51-401c-ac66-28aa152ecdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37200655-9a51-401c-ac66-28aa152ecdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20e4f61-fe40-447e-b1cb-8d1de1ac32e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Volume a38a8a24-256b-466d-b0b2-19b6eba5622e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38a8a24-256b-466d-b0b2-19b6eba5622e', 'volume_size': 1}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:58 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6" returned: 0 in 0.305s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2032727472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe629a04-35a4-4aaa-9945-b8ade92ee92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:57Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Creating volume fe629a04-35a4-4aaa-9945-b8ade92ee92f {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:30:58 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b968d997-93da-4802-8a1f-a6c3703d0238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:58 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f 1073741824
Jul 23 03:30:58 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b76ef1-d31f-429e-8f23-6ba94566f460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Volume volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 (aece1dc0-8343-477c-b292-ef1b1cc6e8c6): created successfully
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b76ef1-d31f-429e-8f23-6ba94566f460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (da83e614-06be-4bf1-a377-5c70368d0eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-647262df-3c65-4527-af67-56d9492ba32b tempest-CreateVolumesFromImageTest-644170370 None] Created volume successfully.
Jul 23 03:30:58 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f 1073741824" returned: 0 in 0.457s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:58 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f
Jul 23 03:30:58 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:58 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:30:58 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:58 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f" returned: 0 in 0.311s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:30:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245623157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe8f324-d50d-489c-bd5e-9ce1e15be79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:57Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Creating volume dbe8f324-d50d-489c-bd5e-9ce1e15be79a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:30:59 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1e39e3-2595-4e3e-b8b3-a4ee812140c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:59 devstack sudo[104888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a 1073741824
Jul 23 03:30:59 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3147f7b-0a22-4c22-ac2a-cfc3b82340e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:59 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Volume volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f (fe629a04-35a4-4aaa-9945-b8ade92ee92f): created successfully
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3147f7b-0a22-4c22-ac2a-cfc3b82340e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (5180e888-dd15-4117-abbe-7f03d5b526f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:59 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c75cbd66-0bdb-4cc0-b7bf-d6ceeb623017 tempest-CreateVolumesFromImageTest-644170370 None] Created volume successfully.
Jul 23 03:30:59 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.300s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:30:59 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a 1073741824" returned: 0 in 0.448s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:59 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a
Jul 23 03:30:59 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:59 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a" returned: 0 in 0.275s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180815280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38a8a24-256b-466d-b0b2-19b6eba5622e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e6179a1006493fb922f1402b4bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:58Z,use_quota=True,user_id='737e14ef74ba4051b3681cb9204c6ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Creating volume a38a8a24-256b-466d-b0b2-19b6eba5622e {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:30:59 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76edcebd-0b61-4982-a3a0-3b755e064d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:59 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e 1073741824
Jul 23 03:30:59 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c5526-eb34-41a4-8a09-d019fe8022e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:30:59 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Volume volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a (dbe8f324-d50d-489c-bd5e-9ce1e15be79a): created successfully
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530c5526-eb34-41a4-8a09-d019fe8022e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:30:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (9299797f-bc10-4406-9e2e-f5258f5bd993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:30:59 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e8900c68-ce81-40c8-8031-37ec4cc58e15 tempest-CreateVolumesFromImageTest-644170370 None] Created volume successfully.
Jul 23 03:31:00 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e 1073741824" returned: 0 in 0.493s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:00 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e
Jul 23 03:31:00 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:00 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e" returned: 0 in 0.248s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20e4f61-fe40-447e-b1cb-8d1de1ac32e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38a8a24-256b-466d-b0b2-19b6eba5622e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbdcccb-b383-4272-b555-0473df5f8c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:00 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Volume volume-a38a8a24-256b-466d-b0b2-19b6eba5622e (a38a8a24-256b-466d-b0b2-19b6eba5622e): created successfully
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbdcccb-b383-4272-b555-0473df5f8c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Flow 'volume_create_manager' (8f7d7e26-3554-42df-9c08-df6bc0aac101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-84ad3ada-66af-4ade-9e8e-48c7c58032b8 tempest-CreateVolumesFromImageTest-644170370 None] Created volume successfully.
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-a38a8a24-256b-466d-b0b2-19b6eba5622e-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-a38a8a24-256b-466d-b0b2-19b6eba5622e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-quobyte-a38a8a24-256b-466d-b0b2-19b6eba5622e" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-a38a8a24-256b-466d-b0b2-19b6eba5622e" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff6888-5c69-4b75-98fb-095cab040026]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:01 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e
Jul 23 03:31:01 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:01 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e" returned: 0 in 0.417s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:01 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e
Jul 23 03:31:01 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:02 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a38a8a24-256b-466d-b0b2-19b6eba5622e" returned: 0 in 0.263s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-a38a8a24-256b-466d-b0b2-19b6eba5622e" released by "delete_volume" :: held 0.732s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Created reservations ['a8273038-2d20-4555-a860-5ab86e35f764', '0d1299e8-ed4e-4252-9193-16e42d288ab7', 'f087adf1-f8f9-47dd-bf80-fb59aec10c46', 'f98842e0-a330-447a-a687-99846d38a83d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:02 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:02 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:02 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-dbe8f324-d50d-489c-bd5e-9ce1e15be79a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Deleted volume successfully.
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-dbe8f324-d50d-489c-bd5e-9ce1e15be79a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22e2f57d-76a4-449a-9b18-e6ad2104134c tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-a38a8a24-256b-466d-b0b2-19b6eba5622e-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-quobyte-dbe8f324-d50d-489c-bd5e-9ce1e15be79a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-dbe8f324-d50d-489c-bd5e-9ce1e15be79a" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece01a1-b6d1-46db-9e9b-8bb8a4dd0397]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:02 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a
Jul 23 03:31:02 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:03 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:03 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a
Jul 23 03:31:03 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:03 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbe8f324-d50d-489c-bd5e-9ce1e15be79a" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-dbe8f324-d50d-489c-bd5e-9ce1e15be79a" released by "delete_volume" :: held 0.684s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Created reservations ['4509955f-b492-48dc-9c0c-364618014491', '895718c9-b2d6-45f7-aa64-c712e81a40c6', '238f4f81-45bf-457f-847d-1f9412540cf9', 'cdf5b7d1-9a02-4e82-b86c-7eee7076f1c2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:03 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:03 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:03 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.261s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Deleted volume successfully.
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f242126b-230e-4c61-8e5c-885aa815dfe5 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-dbe8f324-d50d-489c-bd5e-9ce1e15be79a-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-fe629a04-35a4-4aaa-9945-b8ade92ee92f-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-fe629a04-35a4-4aaa-9945-b8ade92ee92f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-quobyte-fe629a04-35a4-4aaa-9945-b8ade92ee92f" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-fe629a04-35a4-4aaa-9945-b8ade92ee92f" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a254b2a-bf65-4ae5-9ca6-124d83caa330]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:04 devstack sudo[104933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f
Jul 23 03:31:04 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:04 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f" returned: 0 in 0.419s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:04 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f
Jul 23 03:31:04 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:04 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fe629a04-35a4-4aaa-9945-b8ade92ee92f" returned: 0 in 0.296s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-fe629a04-35a4-4aaa-9945-b8ade92ee92f" released by "delete_volume" :: held 0.800s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Created reservations ['1aafef9e-e93c-44bb-ada2-1443b23d6f74', '21ad77ca-6b08-40d1-b3c0-60c342f51137', '6c1a24ec-0f0b-48d8-b279-256a4117c1c9', 'e623cd57-f787-41f5-b8f2-5c67d1d4445e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:04 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:04 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-aece1dc0-8343-477c-b292-ef1b1cc6e8c6-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-aece1dc0-8343-477c-b292-ef1b1cc6e8c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-quobyte-aece1dc0-8343-477c-b292-ef1b1cc6e8c6" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-aece1dc0-8343-477c-b292-ef1b1cc6e8c6" acquired by "delete_volume" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[98043075-8a32-4658-98d2-d59b8d5f9331]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:05 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.395s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Deleted volume successfully.
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b7a23907-4288-45ab-8f19-ed0f5a6def52 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-fe629a04-35a4-4aaa-9945-b8ade92ee92f-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:05 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6
Jul 23 03:31:05 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:05 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:05 devstack sudo[104953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6
Jul 23 03:31:05 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:05 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-aece1dc0-8343-477c-b292-ef1b1cc6e8c6" returned: 0 in 0.272s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-aece1dc0-8343-477c-b292-ef1b1cc6e8c6" released by "delete_volume" :: held 0.735s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:05 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Created reservations ['e15bbe6a-2317-4ac1-8766-86157af443f0', 'ea8a1b83-7ed9-49f0-a510-44ed05ef5cb6', 'b20d39d3-e772-4314-afaa-bfb8f9291021', '4300cdc9-2fbe-41ef-84e6-dfa0587555b9'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:06 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:06 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:06 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-1a4d0087-b3bd-49b8-a0a2-c83328c69044-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:06 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Deleted volume successfully.
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-1a4d0087-b3bd-49b8-a0a2-c83328c69044-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f5db754-9869-4108-b1ed-125dc6d399b7 tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-aece1dc0-8343-477c-b292-ef1b1cc6e8c6-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "cinder-quobyte-1a4d0087-b3bd-49b8-a0a2-c83328c69044" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-1a4d0087-b3bd-49b8-a0a2-c83328c69044" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86a5644-86d8-419c-83e8-60ccf2fa2bbb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:06 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044
Jul 23 03:31:06 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:06 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044" returned: 0 in 0.403s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:06 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044
Jul 23 03:31:06 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:07 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1a4d0087-b3bd-49b8-a0a2-c83328c69044" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-quobyte-1a4d0087-b3bd-49b8-a0a2-c83328c69044" released by "delete_volume" :: held 0.742s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=58,cinder:UPDATE=67,cinder:INSERT=11,cinder:DELETE=7 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:INSERT=21,cinder:DELETE=6 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Created reservations ['5f941617-e6e1-494a-b2c1-bb88d39a1ffe', '3d1e3692-dfb9-4f8b-92e6-f5441433cee1', '9f21e878-9321-4c12-89ce-9f58697aca43', 'c4d61823-35fe-4b7a-bfc5-02cdb3e9c71a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:07 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:07 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:07 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.323s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Deleted volume successfully.
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9e31c4f1-517e-4401-9aa4-b881dd66568f tempest-CreateVolumesFromImageTest-644170370 None] Lock "cinder-1a4d0087-b3bd-49b8-a0a2-c83328c69044-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7662d98-d3de-4720-8773-149275c71af0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:08 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4
Jul 23 03:31:08 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:08 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4" returned: 0 in 0.392s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.427s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236', 'name': 'volume-d296c332-4470-48b8-a431-8e909e09b5a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92ba8e27-136f-487a-80f3-0847fd52ce62', 'enforce_multipath': True} {{(pid=88344) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 23 03:31:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-1bc386ef-f68e-4a72-825e-b136ecbbbc6c req-86cb3b01-126d-4b82-997e-7689819c3539 tempest-TestStampPattern-1344332890 None] attachment_update completed successfully.
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (f14c499b-c594-4040-91f5-7d7e7af71043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b656cdc7-072f-43aa-9858-f3611d0248bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b656cdc7-072f-43aa-9858-f3611d0248bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1395876966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abefd636-6486-4972-b4f5-0d0dafb9e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:11Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529efb3e-95a9-407e-b21d-9b131ed668d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529efb3e-95a9-407e-b21d-9b131ed668d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29c0ea9-1f3c-4078-bf8d-4a464cd73f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29c0ea9-1f3c-4078-bf8d-4a464cd73f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abefd636-6486-4972-b4f5-0d0dafb9e4f4', 'volume_name': 'volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90126a4-cbb2-482e-8d4c-51d3017f9bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90126a4-cbb2-482e-8d4c-51d3017f9bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1338bc8-f53a-490c-aec9-b6c49db58322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume abefd636-6486-4972-b4f5-0d0dafb9e4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4', 'volume_size': 1}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1395876966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abefd636-6486-4972-b4f5-0d0dafb9e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:11Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Creating volume abefd636-6486-4972-b4f5-0d0dafb9e4f4 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:11 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:11 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 1073741824
Jul 23 03:31:11 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [req-8577a2ed-cbff-460a-a9c1-b05d6af30efa req-ee5b6234-6116-40f3-a2bc-29165dae9f0a tempest-TestStampPattern-1344332890 None] Terminate volume connection completed successfully.
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [req-8577a2ed-cbff-460a-a9c1-b05d6af30efa req-ee5b6234-6116-40f3-a2bc-29165dae9f0a tempest-TestStampPattern-1344332890 None] Deleting attachment 92ba8e27-136f-487a-80f3-0847fd52ce62. {{(pid=88344) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 23 03:31:11 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 1073741824" returned: 0 in 0.470s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:11 devstack sudo[105428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4
Jul 23 03:31:11 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:11 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1338bc8-f53a-490c-aec9-b6c49db58322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3817e6-ff25-4814-a4be-3e42137d181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 (abefd636-6486-4972-b4f5-0d0dafb9e4f4): created successfully
Jul 23 03:31:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3817e6-ff25-4814-a4be-3e42137d181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (f14c499b-c594-4040-91f5-7d7e7af71043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-471dc5cf-c86b-48b4-9159-0ee59a590fb8 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created volume successfully.
Jul 23 03:31:13 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (59408a40-6162-424b-85b4-0f43ae025d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:13 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d6bea6-2ecf-4175-9947-e0619919ec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d6bea6-2ecf-4175-9947-e0619919ec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213106027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3a5980-f400-41c6-97e2-672445d969eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:14Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e180b6f7-eed5-42c5-ad4f-13934b325361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e180b6f7-eed5-42c5-ad4f-13934b325361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb942522-2886-4d21-a0d2-945539a5d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb942522-2886-4d21-a0d2-945539a5d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3a5980-f400-41c6-97e2-672445d969eb', 'volume_name': 'volume-3e3a5980-f400-41c6-97e2-672445d969eb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8560c5-bb4a-4e21-a8c5-b9ede8675282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8560c5-bb4a-4e21-a8c5-b9ede8675282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f4d72a-f637-4e87-ba06-cf6baab940b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume 3e3a5980-f400-41c6-97e2-672445d969eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3a5980-f400-41c6-97e2-672445d969eb', 'volume_size': 1}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213106027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3a5980-f400-41c6-97e2-672445d969eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:14Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Creating volume 3e3a5980-f400-41c6-97e2-672445d969eb {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:14 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:14 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb 1073741824
Jul 23 03:31:14 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (3af49c91-80eb-4c3f-b527-46ea38a86234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb98db49-4106-4dae-b568-ef0dfd6326fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb98db49-4106-4dae-b568-ef0dfd6326fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496952670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d807ed3-5268-4e52-8620-a1b2877986eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:15Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb934b6-c3d1-42b3-9b6b-1990c38edb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb934b6-c3d1-42b3-9b6b-1990c38edb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873a2c46-d82a-4a51-8265-5cc166dae7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873a2c46-d82a-4a51-8265-5cc166dae7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d807ed3-5268-4e52-8620-a1b2877986eb', 'volume_name': 'volume-8d807ed3-5268-4e52-8620-a1b2877986eb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d044cd-98aa-45ef-9856-7b59db223557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d044cd-98aa-45ef-9856-7b59db223557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1677431-592a-43cc-94bb-4c1cd97d68bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:14 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume 8d807ed3-5268-4e52-8620-a1b2877986eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d807ed3-5268-4e52-8620-a1b2877986eb', 'volume_size': 1}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb 1073741824" returned: 0 in 0.819s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:14 devstack sudo[105467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb
Jul 23 03:31:14 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Flow 'volume_create_manager' (ed4f763a-3590-4609-8309-65f09bbd1e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46c0474-fe5b-4a22-bdf3-e007506576e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46c0474-fe5b-4a22-bdf3-e007506576e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3178339e-d173-4b45-ae61-9ce292b3701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a83938918c4d8ab2f3f8a868802a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:15Z,use_quota=True,user_id='1fb8e0b060bb46bb9fa36a2616e64390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d38cf2-aaf8-43b5-8bd3-5315c3359a18),volume_type_id=b2d38cf2-aaf8-43b5-8bd3-5315c3359a18)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e287d6c0-50a3-496a-b4ad-72ec2a34a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e287d6c0-50a3-496a-b4ad-72ec2a34a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a237ebc-b51e-47bc-ac6c-7aad3a89015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496952670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d807ed3-5268-4e52-8620-a1b2877986eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:15Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Creating volume 8d807ed3-5268-4e52-8620-a1b2877986eb {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:15 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:15 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb 1073741824
Jul 23 03:31:15 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (cb8e9130-142f-4c5c-9ebe-c7e8a7775dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ab7a16-f216-4d81-80d1-d1911d099bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f4d72a-f637-4e87-ba06-cf6baab940b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3a5980-f400-41c6-97e2-672445d969eb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55595465-c920-4600-bb3b-e53c5466f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ab7a16-f216-4d81-80d1-d1911d099bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100020144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:15Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738f6f0c-e32b-49a6-a4b8-7db38eef85e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738f6f0c-e32b-49a6-a4b8-7db38eef85e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb25805-9966-4b41-a45a-a71839a7e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb25805-9966-4b41-a45a-a71839a7e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65656ba-9c1b-4c16-9a7a-a8108fb2d8e7', 'volume_name': 'volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9598e0f3-750d-48b7-9e08-ca61756a1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9598e0f3-750d-48b7-9e08-ca61756a1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306ac728-98f2-4b6a-8e70-4267b35795fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7', 'volume_size': 1}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume volume-3e3a5980-f400-41c6-97e2-672445d969eb (3e3a5980-f400-41c6-97e2-672445d969eb): created successfully
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55595465-c920-4600-bb3b-e53c5466f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (59408a40-6162-424b-85b4-0f43ae025d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3206d3ae-86c0-42db-a133-2d8c98bbbebd tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created volume successfully.
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (fd2fad4c-95d3-4410-808b-99fd85064191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5b6870-d002-42a4-907b-9bf68ba20cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5b6870-d002-42a4-907b-9bf68ba20cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1532070721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c7ad9d-5431-4462-b1c3-117713b61b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:16Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9174c1d0-4d32-4482-80df-0d008e10977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9174c1d0-4d32-4482-80df-0d008e10977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7315b1-da02-4c09-8491-7949f0c63657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7315b1-da02-4c09-8491-7949f0c63657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c7ad9d-5431-4462-b1c3-117713b61b8c', 'volume_name': 'volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064a3403-2554-4886-9738-d9d1159d6017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064a3403-2554-4886-9738-d9d1159d6017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388521d9-0191-4878-8f5a-485c22e89174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume a6c7ad9d-5431-4462-b1c3-117713b61b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c', 'volume_size': 1}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a237ebc-b51e-47bc-ac6c-7aad3a89015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3178339e-d173-4b45-ae61-9ce292b3701b', 'volume_name': 'volume-3178339e-d173-4b45-ae61-9ce292b3701b', 'volume_size': 1, 'image_id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a59f156c-ef68-45d7-bea6-57e7c78e946b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05c7bdc2fb6a9615d7c43d76cbdf7226', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04a83938918c4d8ab2f3f8a868802a6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c72246f9616af0ae8c9ecd7499a9b861a906662169ea0f5c629fe90aeadf2c6e2458417780e595efb8a6d4b305461392be30a03bbd0c1f5a6bf4c906a3a99967', 'id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'created_at': datetime.datetime(2026, 7, 23, 1, 31, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a59f156c-ef68-45d7-bea6-57e7c78e946b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f40b1d0>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea3c9d0-19c3-4826-acae-2fe0aa46273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea3c9d0-19c3-4826-acae-2fe0aa46273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c36af3-6b65-4742-944a-ce66b2360181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Volume 3178339e-d173-4b45-ae61-9ce292b3701b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3178339e-d173-4b45-ae61-9ce292b3701b', 'volume_size': 1, 'image_id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a59f156c-ef68-45d7-bea6-57e7c78e946b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05c7bdc2fb6a9615d7c43d76cbdf7226', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04a83938918c4d8ab2f3f8a868802a6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c72246f9616af0ae8c9ecd7499a9b861a906662169ea0f5c629fe90aeadf2c6e2458417780e595efb8a6d4b305461392be30a03bbd0c1f5a6bf4c906a3a99967', 'id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'created_at': datetime.datetime(2026, 7, 23, 1, 31, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a59f156c-ef68-45d7-bea6-57e7c78e946b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f40b1d0>}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Trying to clone 3178339e-d173-4b45-ae61-9ce292b3701b from image a59f156c-ef68-45d7-bea6-57e7c78e946b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a59f156c-ef68-45d7-bea6-57e7c78e946b', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-d296c332-4470-48b8-a431-8e909e09b5a4-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Lock "cinder-d296c332-4470-48b8-a431-8e909e09b5a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:15 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb 1073741824" returned: 0 in 0.646s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-quobyte-d296c332-4470-48b8-a431-8e909e09b5a4" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:31:16 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Image download 0.00 MB at 0.00 MB/s
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-d296c332-4470-48b8-a431-8e909e09b5a4" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[571da82d-2dd5-4622-bf67-a7e3ee3adc0d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[efebf11f-c085-4323-8588-24d9ee398894]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:16 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb
Jul 23 03:31:16 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (5710aeac-cff2-492e-b5f2-95c862abe249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89da2d3c-4e54-43fa-bf87-f694725e6ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89da2d3c-4e54-43fa-bf87-f694725e6ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041726924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d9ae7c-a90b-4119-a7b8-3e70583558dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:16Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b723a8be-e5db-468c-a799-164492455c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:16 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD
Jul 23 03:31:16 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b723a8be-e5db-468c-a799-164492455c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bdf240-d947-4cc9-a6e5-8b57f17efd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:16 devstack sudo[105480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4
Jul 23 03:31:16 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bdf240-d947-4cc9-a6e5-8b57f17efd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d9ae7c-a90b-4119-a7b8-3e70583558dd', 'volume_name': 'volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5a7fdc-e070-48bf-90da-ef955cf43f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5a7fdc-e070-48bf-90da-ef955cf43f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58d7dd7-6086-4cd1-bbbe-a91ad268a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume 98d9ae7c-a90b-4119-a7b8-3e70583558dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd', 'volume_size': 1}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:16 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb" returned: 0 in 0.280s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100020144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:15Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Creating volume d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:16 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1677431-592a-43cc-94bb-4c1cd97d68bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d807ed3-5268-4e52-8620-a1b2877986eb', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:16 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 1073741824
Jul 23 03:31:16 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9ac8a0-2be4-4197-afd9-80b340c0711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume volume-8d807ed3-5268-4e52-8620-a1b2877986eb (8d807ed3-5268-4e52-8620-a1b2877986eb): created successfully
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9ac8a0-2be4-4197-afd9-80b340c0711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (3af49c91-80eb-4c3f-b527-46ea38a86234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6c72a6cb-a124-484d-8554-d9f4e0a79a1a tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created volume successfully.
Jul 23 03:31:16 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:16 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4" returned: 0 in 0.475s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:16 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4
Jul 23 03:31:16 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:16 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD
Jul 23 03:31:16 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:16 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d296c332-4470-48b8-a431-8e909e09b5a4" returned: 0 in 0.309s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-d296c332-4470-48b8-a431-8e909e09b5a4" released by "delete_volume" :: held 0.865s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:16 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Temporary image a59f156c-ef68-45d7-bea6-57e7c78e946b is fetched for user 1fb8e0b060bb46bb9fa36a2616e64390. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:31:16 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 1073741824" returned: 0 in 0.561s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Created reservations ['ae11a7d0-62f9-45aa-8dd6-1d19ae26746d', '11d386a7-3954-44d8-8a20-cecd59caa0b9', '29722108-81de-49c2-ba5f-bbd8e419ccb8', '5489cc4e-cc44-4b5c-9027-ffbcd12847c4'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:17 devstack sudo[105514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7
Jul 23 03:31:17 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4925b0a5-8903-4c7a-a119-da8a76a3b13c]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:17 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:17 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:17 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD
Jul 23 03:31:17 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:17 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7" returned: 0 in 0.295s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1532070721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c7ad9d-5431-4462-b1c3-117713b61b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:16Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Creating volume a6c7ad9d-5431-4462-b1c3-117713b61b8c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:17 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306ac728-98f2-4b6a-8e70-4267b35795fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:17 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c 1073741824
Jul 23 03:31:17 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46a5a31-1c9b-451e-a4c5-7071c080ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:17 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 (d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7): created successfully
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46a5a31-1c9b-451e-a4c5-7071c080ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (cb8e9130-142f-4c5c-9ebe-c7e8a7775dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e7ea9c12-8ae2-4710-b7d6-3e3fe8d72864 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created volume successfully.
Jul 23 03:31:17 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.283s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Deleted volume successfully.
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-44935e04-f159-4bd8-a6ef-3f97fe24ba22 tempest-TestStampPattern-1344332890 None] Lock "cinder-d296c332-4470-48b8-a431-8e909e09b5a4-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:17 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:17 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD
Jul 23 03:31:17 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:17 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c 1073741824" returned: 0 in 0.416s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:17 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c
Jul 23 03:31:17 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:17 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:31:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:18 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041726924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d9ae7c-a90b-4119-a7b8-3e70583558dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b94174c847443888bba8a535e5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:16Z,use_quota=True,user_id='971ddb0c559c49649ad4f9fd0fb70126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Creating volume 98d9ae7c-a90b-4119-a7b8-3e70583558dd {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:18 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388521d9-0191-4878-8f5a-485c22e89174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648f9cc2-4e31-45c7-abb6-57d84892641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:18 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd 1073741824
Jul 23 03:31:18 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:18 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c (a6c7ad9d-5431-4462-b1c3-117713b61b8c): created successfully
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648f9cc2-4e31-45c7-abb6-57d84892641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (fd2fad4c-95d3-4410-808b-99fd85064191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8a4aaf5f-56fc-4d36-97cb-80b6bb8ed62d tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created volume successfully.
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-27b6f648-7321-46d6-bcd5-21b953176d40-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Lock "cinder-27b6f648-7321-46d6-bcd5-21b953176d40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-quobyte-23ea1efc-398b-4faa-aa4d-846c69cb1904" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-23ea1efc-398b-4faa-aa4d-846c69cb1904" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-quobyte-27b6f648-7321-46d6-bcd5-21b953176d40" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-27b6f648-7321-46d6-bcd5-21b953176d40" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Deleting offline snapshot 27b6f648-7321-46d6-bcd5-21b953176d40 of volume 23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] snapshot_file for this snap is: volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b6b94-1ef8-4fc0-abc9-47877270a5aa]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:18 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd 1073741824" returned: 0 in 0.481s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:18 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd
Jul 23 03:31:18 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:18 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40
Jul 23 03:31:18 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:18 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd" returned: 0 in 0.246s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3178339e-d173-4b45-ae61-9ce292b3701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a83938918c4d8ab2f3f8a868802a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:15Z,use_quota=True,user_id='1fb8e0b060bb46bb9fa36a2616e64390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d38cf2-aaf8-43b5-8bd3-5315c3359a18),volume_type_id=b2d38cf2-aaf8-43b5-8bd3-5315c3359a18)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Creating volume 3178339e-d173-4b45-ae61-9ce292b3701b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:18 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58d7dd7-6086-4cd1-bbbe-a91ad268a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:18 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b 1073741824
Jul 23 03:31:18 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ba5629-5f58-4b47-a922-702a5fdfb98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:18 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Volume volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd (98d9ae7c-a90b-4119-a7b8-3e70583558dd): created successfully
Jul 23 03:31:18 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ba5629-5f58-4b47-a922-702a5fdfb98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Flow 'volume_create_manager' (5710aeac-cff2-492e-b5f2-95c862abe249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23ea1efc-398b-4faa-aa4d-846c69cb1904(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:31:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7ec9a9b3-72c2-4c42-b66b-e45e5f3102f7 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created volume successfully.
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[86681719-22b7-4fac-bd4c-e24de096cb47]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:19 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:31:19 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:19 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b 1073741824" returned: 0 in 0.440s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:19 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.389s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:19 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b
Jul 23 03:31:19 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:19 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40
Jul 23 03:31:19 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:19 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b" returned: 0 in 0.261s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-98d9ae7c-a90b-4119-a7b8-3e70583558dd-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-98d9ae7c-a90b-4119-a7b8-3e70583558dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Attempting download of a59f156c-ef68-45d7-bea6-57e7c78e946b ((None, [{'url': 'file:///opt/stack/data/glance/images/a59f156c-ef68-45d7-bea6-57e7c78e946b', 'metadata': {}}])) to volume 3178339e-d173-4b45-ae61-9ce292b3701b. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-quobyte-98d9ae7c-a90b-4119-a7b8-3e70583558dd" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-98d9ae7c-a90b-4119-a7b8-3e70583558dd" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab943395-50f1-4e35-8526-674db83fd3ec]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:19 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c685e-5f8d-447d-b298-691bda196e69]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40" returned: 0 in 0.397s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:19 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40
Jul 23 03:31:19 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:19 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5
Jul 23 03:31:19 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:19 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd
Jul 23 03:31:19 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:19 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904.27b6f648-7321-46d6-bcd5-21b953176d40" returned: 0 in 0.257s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-27b6f648-7321-46d6-bcd5-21b953176d40" released by "_delete_snapshot" :: held 1.534s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:20 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5" returned: 0 in 0.342s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-23ea1efc-398b-4faa-aa4d-846c69cb1904" released by "delete_snapshot" :: held 1.570s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:20 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd" returned: 0 in 0.378s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:20 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd
Jul 23 03:31:20 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Created reservations ['a40b3cb0-ccf7-475e-aa3c-bc0092c02d27', 'b5408ce6-db4d-42c5-8dd3-7d58a7363f95', '5e38c58b-172b-4b5e-96d9-6cc6c2b48258', '96e1a4f1-50a4-42c8-afcb-80621f5856f2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:20 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5
Jul 23 03:31:20 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Delete snapshot completed successfully.
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8a92e811-78be-4736-ae0f-fc0fbf87f1d8 tempest-TestStampPattern-1344332890 None] Lock "cinder-27b6f648-7321-46d6-bcd5-21b953176d40-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:20 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-98d9ae7c-a90b-4119-a7b8-3e70583558dd" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-98d9ae7c-a90b-4119-a7b8-3e70583558dd" released by "delete_volume" :: held 0.668s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:20 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5" returned: 1 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a59f156c-ef68-45d7-bea6-57e7c78e946b_xi8i6an5' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4aeb7-026a-4f15-b231-660226fee42b]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created reservations ['d5ba5bba-a97b-4bd1-a438-7037d29ce066', '7b78b474-8341-4a11-af65-5dc4b59c32b7', '8f1dbe2a-43e4-4665-995d-e6bfec184e02', '8aaf2616-723b-406c-ade3-585965971e08'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:20 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:20 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:20 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD
Jul 23 03:31:20 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:20 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.270s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Deleted volume successfully.
Jul 23 03:31:20 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-a6c7ad9d-5431-4462-b1c3-117713b61b8c-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b8145577-0fa9-422e-8a61-0e4627fbf5f1 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-98d9ae7c-a90b-4119-a7b8-3e70583558dd-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-a6c7ad9d-5431-4462-b1c3-117713b61b8c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-quobyte-a6c7ad9d-5431-4462-b1c3-117713b61b8c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-a6c7ad9d-5431-4462-b1c3-117713b61b8c" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:20 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD
Jul 23 03:31:20 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[779855c8-b1a0-4992-b607-c8db6efa51b9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:21 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c
Jul 23 03:31:21 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:21 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] a59f156c-ef68-45d7-bea6-57e7c78e946b was raw, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:21 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b
Jul 23 03:31:21 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:21 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c" returned: 0 in 0.424s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:21 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c
Jul 23 03:31:21 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:21 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a6c7ad9d-5431-4462-b1c3-117713b61b8c" returned: 0 in 0.330s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-a6c7ad9d-5431-4462-b1c3-117713b61b8c" released by "delete_volume" :: held 0.807s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:21 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b" returned: 0 in 0.624s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a59f156c-ef68-45d7-bea6-57e7c78e946b_m4j_z6bhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:31:21 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Converted 0.00 MB image at 0.00 MB/s
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created reservations ['4f904ced-1c3d-4a55-9bda-4bb36720f8e4', '9b593ddd-09ef-4e26-9b8d-80544fa5cf8b', '28ae5f4c-3408-4a3a-b0e8-b9ab133cc7ca', '95a2cce1-97ab-4df5-98ba-f1f3bb774bcb'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:21 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b 1G
Jul 23 03:31:21 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:21 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:21 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-quobyte-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7" acquired by "delete_volume" :: waited 0.053s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5446507-c354-469a-a696-afc66da7670f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:22 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.339s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Deleted volume successfully.
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-88f7ee5a-f9e3-422a-b2af-d97818a59105 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-a6c7ad9d-5431-4462-b1c3-117713b61b8c-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:22 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b 1G" returned: 0 in 0.697s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Downloaded image a59f156c-ef68-45d7-bea6-57e7c78e946b ((None, [{'url': 'file:///opt/stack/data/glance/images/a59f156c-ef68-45d7-bea6-57e7c78e946b', 'metadata': {}}])) to volume 3178339e-d173-4b45-ae61-9ce292b3701b successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Temporary image a59f156c-ef68-45d7-bea6-57e7c78e946b for user 1fb8e0b060bb46bb9fa36a2616e64390 is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Marking volume 3178339e-d173-4b45-ae61-9ce292b3701b as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:31:22 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7
Jul 23 03:31:22 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Copying metadata from image a59f156c-ef68-45d7-bea6-57e7c78e946b to 3178339e-d173-4b45-ae61-9ce292b3701b. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Creating volume glance metadata for volume 3178339e-d173-4b45-ae61-9ce292b3701b backed by image a59f156c-ef68-45d7-bea6-57e7c78e946b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '05c7bdc2fb6a9615d7c43d76cbdf7226', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c36af3-6b65-4742-944a-ce66b2360181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3178339e-d173-4b45-ae61-9ce292b3701b', 'volume_size': 1, 'image_id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a59f156c-ef68-45d7-bea6-57e7c78e946b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05c7bdc2fb6a9615d7c43d76cbdf7226', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04a83938918c4d8ab2f3f8a868802a6c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c72246f9616af0ae8c9ecd7499a9b861a906662169ea0f5c629fe90aeadf2c6e2458417780e595efb8a6d4b305461392be30a03bbd0c1f5a6bf4c906a3a99967', 'id': 'a59f156c-ef68-45d7-bea6-57e7c78e946b', 'created_at': datetime.datetime(2026, 7, 23, 1, 31, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a59f156c-ef68-45d7-bea6-57e7c78e946b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f40b1d0>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760f2b0f-dc25-44b5-9840-0d052f214e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:22 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Volume volume-3178339e-d173-4b45-ae61-9ce292b3701b (3178339e-d173-4b45-ae61-9ce292b3701b): created successfully
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760f2b0f-dc25-44b5-9840-0d052f214e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Flow 'volume_create_manager' (ed4f763a-3590-4609-8309-65f09bbd1e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fa65a9c7-8f2c-4a7b-a64e-6f20d85b954d tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Created volume successfully.
Jul 23 03:31:22 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7" returned: 0 in 0.523s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:22 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7
Jul 23 03:31:22 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:23 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7" returned: 0 in 0.285s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7" released by "delete_volume" :: held 0.866s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created reservations ['c4c52cfc-cecd-4710-9107-e8434eb46687', '6c5e6107-0de9-4747-a8c1-e6e9bc50d9d5', 'e415fb46-8c7e-4457-a7ef-8148bf4d6324', '9c2f34ba-e8d1-4012-aac9-70700c2afad1'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:23 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:23 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Acquiring lock "cinder-3178339e-d173-4b45-ae61-9ce292b3701b-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "cinder-3178339e-d173-4b45-ae61-9ce292b3701b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:23 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.331s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Deleted volume successfully.
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Acquiring lock "cinder-quobyte-3178339e-d173-4b45-ae61-9ce292b3701b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "cinder-quobyte-3178339e-d173-4b45-ae61-9ce292b3701b" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8922ae4-b2f8-4828-b1a0-3b789dd60131 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-d65656ba-9c1b-4c16-9a7a-a8108fb2d8e7-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3077a0-b419-4330-ae97-165da5554255]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:23 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b
Jul 23 03:31:23 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:23 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:23 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b
Jul 23 03:31:23 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:24 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3178339e-d173-4b45-ae61-9ce292b3701b" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "cinder-quobyte-3178339e-d173-4b45-ae61-9ce292b3701b" released by "delete_volume" :: held 0.648s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-8d807ed3-5268-4e52-8620-a1b2877986eb-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-8d807ed3-5268-4e52-8620-a1b2877986eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:24 devstack cinder-volume[88344]: WARNING cinder.quota [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:31:24 devstack cinder-volume[88344]: WARNING cinder.quota [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Created reservations ['aeb54308-8ca4-4379-a8b8-09ce5625b012', 'c4b81ce1-cfa8-4e0f-9ebf-11c1a9dc4e2c', '9f3be212-94a0-49af-b7b0-dc7efb5f469b', 'f3656786-134a-4a82-9e96-084c2177d762'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-quobyte-8d807ed3-5268-4e52-8620-a1b2877986eb" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-8d807ed3-5268-4e52-8620-a1b2877986eb" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0587e947-ae97-451d-8e73-7d5180e7d0a5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:24 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:24 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:24 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb
Jul 23 03:31:24 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-23ea1efc-398b-4faa-aa4d-846c69cb1904-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Lock "cinder-23ea1efc-398b-4faa-aa4d-846c69cb1904-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Acquiring lock "cinder-quobyte-23ea1efc-398b-4faa-aa4d-846c69cb1904" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-23ea1efc-398b-4faa-aa4d-846c69cb1904" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd263a0-33b6-407d-a28f-2bdc1c00debd]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:24 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.312s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Deleted volume successfully.
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6372a674-d01a-49bf-adb2-d645b4a49102 tempest-VolumeAndVolumeTypeFromImageTest-916386669 None] Lock "cinder-3178339e-d173-4b45-ae61-9ce292b3701b-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:24 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb" returned: 0 in 0.435s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:24 devstack sudo[105682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb
Jul 23 03:31:24 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:24 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:31:24 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:25 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d807ed3-5268-4e52-8620-a1b2877986eb" returned: 0 in 0.267s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-8d807ed3-5268-4e52-8620-a1b2877986eb" released by "delete_volume" :: held 0.747s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:25 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.404s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:25 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904
Jul 23 03:31:25 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created reservations ['cd0adbee-ddc7-4115-9e29-33f515c06b27', '7753b96e-4895-4d56-8e4c-fa294adbf0fa', '4a2a1745-e986-40f2-914f-00c18245b775', '08e1df63-18f0-41a0-a632-bab02a55d4f1'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:25 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:25 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:25 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-23ea1efc-398b-4faa-aa4d-846c69cb1904" returned: 0 in 0.269s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Lock "cinder-quobyte-23ea1efc-398b-4faa-aa4d-846c69cb1904" released by "delete_volume" :: held 0.747s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-3e3a5980-f400-41c6-97e2-672445d969eb-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-3e3a5980-f400-41c6-97e2-672445d969eb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-quobyte-3e3a5980-f400-41c6-97e2-672445d969eb" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:25 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Deleted volume successfully.
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-3e3a5980-f400-41c6-97e2-672445d969eb" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Created reservations ['d7aa61d4-a48f-4f65-82e7-69f6e956364f', '8957507a-7adb-4d86-87b8-6e2891159275', '7574ee05-9f2a-4d6f-8106-237eeded30c5', 'ac831c0c-8413-4edf-b942-615782cd0ce3'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[987faa04-e4e7-4912-8db0-ba3cd27de4c4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e225c9b4-118f-4bd9-9194-c8fdc1a0f5fa tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-8d807ed3-5268-4e52-8620-a1b2877986eb-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:25 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb
Jul 23 03:31:25 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:25 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:25 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:25 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.295s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Deleted volume successfully.
Jul 23 03:31:25 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb" returned: 0 in 0.432s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2ca22e73-9f7c-4fd8-bf6e-e2a692a1e239 tempest-TestStampPattern-1344332890 None] Lock "cinder-23ea1efc-398b-4faa-aa4d-846c69cb1904-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:26 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb
Jul 23 03:31:26 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:26 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-3e3a5980-f400-41c6-97e2-672445d969eb" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-3e3a5980-f400-41c6-97e2-672445d969eb" released by "delete_volume" :: held 0.774s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created reservations ['17e494c1-eb74-4e63-9697-6f114633b230', '1fd9269b-cc70-4994-8c65-5ff825fa8820', '7eaa6edf-860c-4c55-ac99-7c0b7f2fcc99', '58938873-14fc-4281-b116-d4f881a82c80'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:26 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:26 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-abefd636-6486-4972-b4f5-0d0dafb9e4f4-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-abefd636-6486-4972-b4f5-0d0dafb9e4f4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "cinder-quobyte-abefd636-6486-4972-b4f5-0d0dafb9e4f4" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-abefd636-6486-4972-b4f5-0d0dafb9e4f4" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:26 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7a4b6e-483a-4964-9b68-60835a8e4f81]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.439s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Deleted volume successfully.
Jul 23 03:31:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-adf0efe9-79be-4c0b-b0c0-9b451d6fa51f tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-3e3a5980-f400-41c6-97e2-672445d969eb-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:27 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4
Jul 23 03:31:27 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:27 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4" returned: 0 in 0.427s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:27 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4
Jul 23 03:31:27 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:27 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-abefd636-6486-4972-b4f5-0d0dafb9e4f4" returned: 0 in 0.306s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-quobyte-abefd636-6486-4972-b4f5-0d0dafb9e4f4" released by "delete_volume" :: held 0.794s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Created reservations ['952a0d0a-f00a-4153-85e7-a5aaa32be28c', '5abcf10f-ef06-4af7-8be0-afb80c3965f5', '685d4729-ca9f-4dee-b22e-342c2a1157a5', 'a080b611-4dac-487e-9a8f-7c82c2649918'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:27 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:27 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:28 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:28 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Deleted volume successfully.
Jul 23 03:31:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d94a3c0e-100f-4f28-9686-da72128dd320 tempest-CreateVolumesFromSourceVolumeTest-441564150 None] Lock "cinder-abefd636-6486-4972-b4f5-0d0dafb9e4f4-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:29 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Flow 'volume_create_manager' (c498a458-65e4-4642-98e0-76722bc39f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abacb34-7892-49d7-933f-534ac187c648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abacb34-7892-49d7-933f-534ac187c648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bfe777-15b7-4208-93be-9585eb681e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3f767843a649b5af119900d48f607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:30Z,use_quota=True,user_id='54001c1097e84a5d86ec1ede7b0dfd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86b9fff-5fed-4bfe-adad-ad8d55c5d5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86b9fff-5fed-4bfe-adad-ad8d55c5d5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8892d79-2065-4c31-91e6-d8b38833f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8892d79-2065-4c31-91e6-d8b38833f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bfe777-15b7-4208-93be-9585eb681e68', 'volume_name': 'volume-88bfe777-15b7-4208-93be-9585eb681e68', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c8a7ba-2ea1-48ac-b9b8-f608fce83c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c8a7ba-2ea1-48ac-b9b8-f608fce83c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa7cd67-5b7f-4ec7-a1ca-1ba2a537a165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:30 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Volume 88bfe777-15b7-4208-93be-9585eb681e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bfe777-15b7-4208-93be-9585eb681e68', 'volume_size': 1}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bfe777-15b7-4208-93be-9585eb681e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3f767843a649b5af119900d48f607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:30Z,use_quota=True,user_id='54001c1097e84a5d86ec1ede7b0dfd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Creating volume 88bfe777-15b7-4208-93be-9585eb681e68 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:30 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:30 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68 1073741824
Jul 23 03:31:30 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:30 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68 1073741824" returned: 0 in 0.465s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:30 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68
Jul 23 03:31:30 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:30 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68" returned: 0 in 0.312s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa7cd67-5b7f-4ec7-a1ca-1ba2a537a165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bfe777-15b7-4208-93be-9585eb681e68', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0561eca4-fbdb-43e8-a07e-07acf4c2a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:30 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Volume volume-88bfe777-15b7-4208-93be-9585eb681e68 (88bfe777-15b7-4208-93be-9585eb681e68): created successfully
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0561eca4-fbdb-43e8-a07e-07acf4c2a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:30 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Flow 'volume_create_manager' (c498a458-65e4-4642-98e0-76722bc39f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f3acc506-f7e7-414b-ab82-a035aef80d6f tempest-CinderUnicodeTest-1299678260 None] Created volume successfully.
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Flow 'volume_create_manager' (171d735e-bd35-4045-ae8c-c2a3f382eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e137477-f082-4cb7-aae0-1ad5c07e737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e137477-f082-4cb7-aae0-1ad5c07e737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-972223810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69348c2-f773-417c-b5bf-a400f6a2a1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3f767843a649b5af119900d48f607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:33Z,use_quota=True,user_id='54001c1097e84a5d86ec1ede7b0dfd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f109ef-e7d4-4f88-a734-6dd65ca20a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f109ef-e7d4-4f88-a734-6dd65ca20a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411300cb-1562-4126-8832-9de59db711c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411300cb-1562-4126-8832-9de59db711c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69348c2-f773-417c-b5bf-a400f6a2a1d6', 'volume_name': 'volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d704fad-d97a-4dcd-8941-0a2ed4d5b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d704fad-d97a-4dcd-8941-0a2ed4d5b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c7a1da-600d-4554-b575-8e49455d5a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:32 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Volume f69348c2-f773-417c-b5bf-a400f6a2a1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6', 'volume_size': 1}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-972223810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69348c2-f773-417c-b5bf-a400f6a2a1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3f767843a649b5af119900d48f607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:33Z,use_quota=True,user_id='54001c1097e84a5d86ec1ede7b0dfd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Creating volume f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:32 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:32 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 1073741824
Jul 23 03:31:32 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:33 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 1073741824" returned: 0 in 0.499s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:33 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6
Jul 23 03:31:33 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:33 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6" returned: 0 in 0.265s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c7a1da-600d-4554-b575-8e49455d5a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c52863-dd5b-45f8-9ee0-ad1a2c5f8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Volume volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 (f69348c2-f773-417c-b5bf-a400f6a2a1d6): created successfully
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c52863-dd5b-45f8-9ee0-ad1a2c5f8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Flow 'volume_create_manager' (171d735e-bd35-4045-ae8c-c2a3f382eca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-89f5960a-5c75-46f3-bec1-fd8803bf2203 tempest-CinderUnicodeTest-1299678260 None] Created volume successfully.
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Creating offline snapshot e77d725b-94a5-4ba6-b8ea-49d5a6beda64 of volume f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d68cd-558f-4748-9e70-d57f16ce8398]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:35 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6
Jul 23 03:31:35 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:35 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6" returned: 0 in 0.391s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:35 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 1G
Jul 23 03:31:35 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:35 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 1G" returned: 0 in 0.406s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:35 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64
Jul 23 03:31:35 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:36 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64" returned: 0 in 0.306s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:36 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 is being set with open permissions: ugo+rw
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:36 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64
Jul 23 03:31:36 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:36 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64" returned: 0 in 0.238s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:36 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info
Jul 23 03:31:36 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:36 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info" returned: 0 in 0.288s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:36 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info is being set with open permissions: ugo+rw
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:36 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info
Jul 23 03:31:36 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:36 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.info" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f6bbe5f9-3de8-423e-b5f1-5565be618cef tempest-CinderUnicodeTest-1299678260 None] Create snapshot completed successfully
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-e77d725b-94a5-4ba6-b8ea-49d5a6beda64-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-e77d725b-94a5-4ba6-b8ea-49d5a6beda64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-quobyte-f69348c2-f773-417c-b5bf-a400f6a2a1d6" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-f69348c2-f773-417c-b5bf-a400f6a2a1d6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-quobyte-e77d725b-94a5-4ba6-b8ea-49d5a6beda64" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-e77d725b-94a5-4ba6-b8ea-49d5a6beda64" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Deleting offline snapshot e77d725b-94a5-4ba6-b8ea-49d5a6beda64 of volume f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] snapshot_file for this snap is: volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4bf5ce-b5ac-4b75-8b08-f2c1421384b1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:37 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64
Jul 23 03:31:37 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:37 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7752a2-5762-4320-a95c-e43b6f180961]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (07060c41-a54a-4f94-9724-591ba94cceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bcb7ec-3d28-4c5c-a67c-c1f65a5ea36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bcb7ec-3d28-4c5c-a67c-c1f65a5ea36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-49763645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc1ab68-a16c-46dd-8ae0-a37f1442801d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:38Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c8ee54-ef1b-471e-bf36-421b12dd5247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c8ee54-ef1b-471e-bf36-421b12dd5247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:37 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6
Jul 23 03:31:37 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69616354-9d67-428c-8710-96a8dabdcc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69616354-9d67-428c-8710-96a8dabdcc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc1ab68-a16c-46dd-8ae0-a37f1442801d', 'volume_name': 'volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8327b77-2c47-40c6-8860-4f682827924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8327b77-2c47-40c6-8860-4f682827924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0550f397-8cdf-4405-8702-5be6b288a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:37 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume dbc1ab68-a16c-46dd-8ae0-a37f1442801d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d', 'volume_size': 1}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-49763645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc1ab68-a16c-46dd-8ae0-a37f1442801d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:38Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating volume dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:37 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:37 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d 1073741824
Jul 23 03:31:37 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:38 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6" returned: 0 in 0.352s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:38 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64
Jul 23 03:31:38 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:38 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d 1073741824" returned: 0 in 0.404s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:38 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d
Jul 23 03:31:38 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:38 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64" returned: 0 in 0.356s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:38 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64
Jul 23 03:31:38 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:38 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0550f397-8cdf-4405-8702-5be6b288a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa1c39f-f714-4b55-849f-592767257074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d (dbc1ab68-a16c-46dd-8ae0-a37f1442801d): created successfully
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa1c39f-f714-4b55-849f-592767257074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (07060c41-a54a-4f94-9724-591ba94cceae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-82d419dc-d576-4e4d-9dc7-ffe04a3cbc17 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created volume successfully.
Jul 23 03:31:38 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6.e77d725b-94a5-4ba6-b8ea-49d5a6beda64" returned: 0 in 0.233s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-e77d725b-94a5-4ba6-b8ea-49d5a6beda64" released by "_delete_snapshot" :: held 1.407s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-f69348c2-f773-417c-b5bf-a400f6a2a1d6" released by "delete_snapshot" :: held 1.434s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Created reservations ['a9e144e6-92bb-4be5-a08e-f302aa964957', '17ecd255-f89a-4733-94a5-0907905c311d', 'ba52f594-d558-4596-8a27-a8c09f397e19', '1412d223-d2b0-41aa-8f77-a8108bd51e11'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Delete snapshot completed successfully.
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cb173ca0-810e-4bea-bed3-219857c3ef0e tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-e77d725b-94a5-4ba6-b8ea-49d5a6beda64-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating offline snapshot 6981c8c6-b963-4260-9c2c-4cd9b960a3c6 of volume dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e21d94-4df8-47bc-ae36-0921f56295e7]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:39 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d
Jul 23 03:31:39 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-f69348c2-f773-417c-b5bf-a400f6a2a1d6-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:39 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-f69348c2-f773-417c-b5bf-a400f6a2a1d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" returned: 0 in 0.360s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:39 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 1G
Jul 23 03:31:39 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-quobyte-f69348c2-f773-417c-b5bf-a400f6a2a1d6" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-f69348c2-f773-417c-b5bf-a400f6a2a1d6" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f3ff2-57b6-4c40-b9c3-27c2051bcdf1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:39 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6
Jul 23 03:31:39 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:39 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 1G" returned: 0 in 0.393s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:39 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6
Jul 23 03:31:39 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:39 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6" returned: 0 in 0.358s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:39 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6
Jul 23 03:31:39 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:40 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6" returned: 0 in 0.283s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:40 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 is being set with open permissions: ugo+rw
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:40 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f69348c2-f773-417c-b5bf-a400f6a2a1d6" returned: 0 in 0.242s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:40 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6
Jul 23 03:31:40 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-f69348c2-f773-417c-b5bf-a400f6a2a1d6" released by "delete_volume" :: held 0.654s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Created reservations ['dd2263a1-21b0-47dc-8ff9-3de69839cbe7', '63409768-2a3b-458f-84c9-f64f01addb7e', 'b1e038bb-33ba-400a-a7a1-b5f30682feaa', '1157ab54-c2f6-4408-acc3-29fcfced093a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:40 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:40 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:40 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6" returned: 0 in 0.248s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:40 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info
Jul 23 03:31:40 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:40 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Deleted volume successfully.
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6745787a-9ab2-4a3b-a941-9d2586c24d61 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-f69348c2-f773-417c-b5bf-a400f6a2a1d6-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-88bfe777-15b7-4208-93be-9585eb681e68-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-88bfe777-15b7-4208-93be-9585eb681e68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "cinder-quobyte-88bfe777-15b7-4208-93be-9585eb681e68" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:40 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info" returned: 0 in 0.269s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:40 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info is being set with open permissions: ugo+rw
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-88bfe777-15b7-4208-93be-9585eb681e68" acquired by "delete_volume" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:40 devstack sudo[105866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info
Jul 23 03:31:40 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[43611fec-2aa8-4715-9d52-78b0181f9f4f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:40 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68
Jul 23 03:31:40 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:40 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.info" returned: 0 in 0.237s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a7d69f11-fac2-463c-bf0a-654c9f9a0fca tempest-CreateVolumesFromSnapshotTest-413943052 None] Create snapshot completed successfully
Jul 23 03:31:40 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68" returned: 0 in 0.359s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:41 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68
Jul 23 03:31:41 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:41 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-88bfe777-15b7-4208-93be-9585eb681e68" returned: 0 in 0.241s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-quobyte-88bfe777-15b7-4208-93be-9585eb681e68" released by "delete_volume" :: held 0.644s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Created reservations ['d9a24661-f529-4f57-b4ad-3a285eac9e70', '983ee980-3c69-46f9-985d-ef9e66c5cb45', '27b44b76-3a3c-4ffc-824f-7d5ae9a28b42', 'd7cb2b63-7b66-4d27-8820-b49d0da48aa3'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:41 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:41 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (37b4713a-15c5-4092-a7df-0c93a22fc98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d5413a-6223-48c5-80a4-e5afb1881f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d5413a-6223-48c5-80a4-e5afb1881f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836074077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:41Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc20c30d-aaf5-4f5e-a577-332a7d902fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc20c30d-aaf5-4f5e-a577-332a7d902fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64403307-7ad6-449d-af40-4d12c2c11f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64403307-7ad6-449d-af40-4d12c2c11f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c', 'volume_name': 'volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9068dcba-8459-4303-b5d7-c67d2be4c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9068dcba-8459-4303-b5d7-c67d2be4c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7d0209-0ccc-4626-a060-6ba0bdc48805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume 7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c', 'volume_size': 1}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836074077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:41Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating volume 7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:41 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:41 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.280s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:41 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c 1073741824
Jul 23 03:31:41 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Deleted volume successfully.
Jul 23 03:31:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464231fb-18ce-4583-aa54-76ea7ad54897 tempest-CinderUnicodeTest-1299678260 None] Lock "cinder-88bfe777-15b7-4208-93be-9585eb681e68-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (2962f964-819e-485c-93ef-56f85583cc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e981649f-6032-4ce8-85bc-0b739d637e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e981649f-6032-4ce8-85bc-0b739d637e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721570196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4d7c41-dec3-4edd-86b4-f50c803f3bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:42Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b84b76-8373-40fd-9a42-8ff5d6d29470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b84b76-8373-40fd-9a42-8ff5d6d29470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a8c751-97fc-4145-927f-5fc87871437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a8c751-97fc-4145-927f-5fc87871437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b4d7c41-dec3-4edd-86b4-f50c803f3bbe', 'volume_name': 'volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e440dd5d-c464-48c9-b558-bfa710a858bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e440dd5d-c464-48c9-b558-bfa710a858bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402b3545-19c7-4960-9022-af0852027cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume 6b4d7c41-dec3-4edd-86b4-f50c803f3bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe', 'volume_size': 1}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:42 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c 1073741824" returned: 0 in 0.559s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:42 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c
Jul 23 03:31:42 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (47f28aab-fbe3-427f-94df-6f5782e2f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5b47dc-78bc-476b-b3c6-ad38c5e49750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5b47dc-78bc-476b-b3c6-ad38c5e49750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662244919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d4400c-dab6-4e26-8fa9-8922f5da9b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:42Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828f9eff-d1cb-402b-b6df-422b526f3fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828f9eff-d1cb-402b-b6df-422b526f3fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7805ec-3043-4ffd-a729-1df5525a7bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7805ec-3043-4ffd-a729-1df5525a7bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d4400c-dab6-4e26-8fa9-8922f5da9b93', 'volume_name': 'volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c733552c-9b81-4d30-8060-33d17b21836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c733552c-9b81-4d30-8060-33d17b21836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e51dc2d-7495-4eae-b060-b11543caaffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume 86d4400c-dab6-4e26-8fa9-8922f5da9b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93', 'volume_size': 1}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:42 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721570196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4d7c41-dec3-4edd-86b4-f50c803f3bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:42Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating volume 6b4d7c41-dec3-4edd-86b4-f50c803f3bbe {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:42 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:42 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe 1073741824
Jul 23 03:31:42 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7d0209-0ccc-4626-a060-6ba0bdc48805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5819e66-52f7-46c0-862f-a01844132d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c (7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c): created successfully
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5819e66-52f7-46c0-862f-a01844132d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (37b4713a-15c5-4092-a7df-0c93a22fc98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-51756274-013b-4d42-8f8e-ab018b66bce4 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created volume successfully.
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (79b81f9d-db10-4ec6-b3c3-ed6232345042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d176fe-ea81-48a5-b331-8891bce11368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d176fe-ea81-48a5-b331-8891bce11368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493809332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1546c6a-e002-4e35-964f-67b4d19690b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:43Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeacca9-484f-4be0-b97d-809f51ce791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeacca9-484f-4be0-b97d-809f51ce791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74211566-f8e3-40c2-8035-13faa15bc5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74211566-f8e3-40c2-8035-13faa15bc5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1546c6a-e002-4e35-964f-67b4d19690b9', 'volume_name': 'volume-b1546c6a-e002-4e35-964f-67b4d19690b9', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0766aa-7147-4c86-9a2c-08c17807b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0766aa-7147-4c86-9a2c-08c17807b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40214f40-14a6-4df8-8b52-318acc861fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume b1546c6a-e002-4e35-964f-67b4d19690b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1546c6a-e002-4e35-964f-67b4d19690b9', 'volume_size': 1}
Jul 23 03:31:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (49366cec-dec4-4159-b469-135220769669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93edfb7-f2be-4bca-8937-9de12f1b03ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:43 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe 1073741824" returned: 0 in 0.725s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93edfb7-f2be-4bca-8937-9de12f1b03ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169026258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178c944c-54e9-491a-b0fc-f5e4dac94a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:43Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9130823d-3ab1-4b27-a031-4ec513f60c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9130823d-3ab1-4b27-a031-4ec513f60c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248e9c7a-f4f1-4fe0-8010-2443b085d2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248e9c7a-f4f1-4fe0-8010-2443b085d2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178c944c-54e9-491a-b0fc-f5e4dac94a44', 'volume_name': 'volume-178c944c-54e9-491a-b0fc-f5e4dac94a44', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e097b4ea-36e4-4697-a3d2-d300bed59391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e097b4ea-36e4-4697-a3d2-d300bed59391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d8eb0d-2e0e-4a77-9d69-51c0a414d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume 178c944c-54e9-491a-b0fc-f5e4dac94a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178c944c-54e9-491a-b0fc-f5e4dac94a44', 'volume_size': 1}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:43 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe
Jul 23 03:31:43 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:43 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662244919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d4400c-dab6-4e26-8fa9-8922f5da9b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:42Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating volume 86d4400c-dab6-4e26-8fa9-8922f5da9b93 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:43 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402b3545-19c7-4960-9022-af0852027cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:43 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 1073741824
Jul 23 03:31:43 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8375b8-7645-4da9-a0d7-d7bd543f2349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe (6b4d7c41-dec3-4edd-86b4-f50c803f3bbe): created successfully
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8375b8-7645-4da9-a0d7-d7bd543f2349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (2962f964-819e-485c-93ef-56f85583cc40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0b44d5ae-0d88-4172-a3cd-04be60c21c3f tempest-CreateVolumesFromSnapshotTest-413943052 None] Created volume successfully.
Jul 23 03:31:44 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 1073741824" returned: 0 in 0.474s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:44 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93
Jul 23 03:31:44 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:44 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93" returned: 0 in 0.268s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493809332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1546c6a-e002-4e35-964f-67b4d19690b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:43Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating volume b1546c6a-e002-4e35-964f-67b4d19690b9 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:44 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e51dc2d-7495-4eae-b060-b11543caaffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d51d544-51bb-4b72-9053-173ad493a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:44 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9 1073741824
Jul 23 03:31:44 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:44 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 (86d4400c-dab6-4e26-8fa9-8922f5da9b93): created successfully
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d51d544-51bb-4b72-9053-173ad493a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (47f28aab-fbe3-427f-94df-6f5782e2f16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-59cf3a5c-ef7a-4f9c-8e5b-692357e08a7e tempest-CreateVolumesFromSnapshotTest-413943052 None] Created volume successfully.
Jul 23 03:31:44 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9 1073741824" returned: 0 in 0.467s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:44 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9
Jul 23 03:31:44 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:45 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9" returned: 0 in 0.255s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169026258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178c944c-54e9-491a-b0fc-f5e4dac94a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09602c1e1524b2cb1db814bfcb71f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:43Z,use_quota=True,user_id='1f07100f1f7d440aad13da7ecbc1dda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Creating volume 178c944c-54e9-491a-b0fc-f5e4dac94a44 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:31:45 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40214f40-14a6-4df8-8b52-318acc861fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1546c6a-e002-4e35-964f-67b4d19690b9', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:45 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 1073741824
Jul 23 03:31:45 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256b6da-f078-440a-8d62-d159fef79cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:45 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume volume-b1546c6a-e002-4e35-964f-67b4d19690b9 (b1546c6a-e002-4e35-964f-67b4d19690b9): created successfully
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256b6da-f078-440a-8d62-d159fef79cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (79b81f9d-db10-4ec6-b3c3-ed6232345042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e633a931-1696-4f67-9f27-dab07f0c49cd tempest-CreateVolumesFromSnapshotTest-413943052 None] Created volume successfully.
Jul 23 03:31:45 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 1073741824" returned: 0 in 0.497s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:45 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44
Jul 23 03:31:45 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:46 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d8eb0d-2e0e-4a77-9d69-51c0a414d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178c944c-54e9-491a-b0fc-f5e4dac94a44', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7943cc14-1b0c-4d6c-a4eb-90e74cc26316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:31:46 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Volume volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 (178c944c-54e9-491a-b0fc-f5e4dac94a44): created successfully
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7943cc14-1b0c-4d6c-a4eb-90e74cc26316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Flow 'volume_create_manager' (49366cec-dec4-4159-b469-135220769669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:31:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8203a62d-c02d-47d7-878f-e5840b521585 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created volume successfully.
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-178c944c-54e9-491a-b0fc-f5e4dac94a44-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-178c944c-54e9-491a-b0fc-f5e4dac94a44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-178c944c-54e9-491a-b0fc-f5e4dac94a44" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-178c944c-54e9-491a-b0fc-f5e4dac94a44" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[93249e55-b3a4-4a43-a7c8-c51c4ae6888b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:46 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44
Jul 23 03:31:46 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:47 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:47 devstack sudo[105931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44
Jul 23 03:31:47 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:47 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-178c944c-54e9-491a-b0fc-f5e4dac94a44" returned: 0 in 0.235s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-178c944c-54e9-491a-b0fc-f5e4dac94a44" released by "delete_volume" :: held 0.679s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['4405d054-71d7-47e5-aea2-64fee1aa6cb1', '39a4d027-73da-413c-827c-b39c123598d6', '8d1a0a8e-c390-4828-b520-74542386e966', '5746b4ab-3b4f-4f56-b3a1-5931f59b535f'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:47 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:47 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:47 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.279s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleted volume successfully.
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-07bd4227-f6ef-4a12-89aa-0a70632761c1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-178c944c-54e9-491a-b0fc-f5e4dac94a44-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-b1546c6a-e002-4e35-964f-67b4d19690b9-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-b1546c6a-e002-4e35-964f-67b4d19690b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-b1546c6a-e002-4e35-964f-67b4d19690b9" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-b1546c6a-e002-4e35-964f-67b4d19690b9" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f6e653-4326-470e-8d4a-3d5ff7fdc950]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:48 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9
Jul 23 03:31:48 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:48 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9" returned: 0 in 0.395s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:48 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9
Jul 23 03:31:48 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:48 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b1546c6a-e002-4e35-964f-67b4d19690b9" returned: 0 in 0.247s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-b1546c6a-e002-4e35-964f-67b4d19690b9" released by "delete_volume" :: held 0.683s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['b9e2de3f-9266-4509-93d7-db5a85843c3c', '497e3e9c-da0e-4804-a50d-a72ca571aa1f', '2b52c403-97d9-4b86-a4d1-e8df734e1081', '15b9d6c9-60bf-48ac-b3f1-abf997af4a46'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:48 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:48 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:49 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:49 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleted volume successfully.
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-86d4400c-dab6-4e26-8fa9-8922f5da9b93-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-86d4400c-dab6-4e26-8fa9-8922f5da9b93-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e3f6c9a3-e9c0-4cd0-9963-a0146163dde1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-b1546c6a-e002-4e35-964f-67b4d19690b9-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-86d4400c-dab6-4e26-8fa9-8922f5da9b93" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-86d4400c-dab6-4e26-8fa9-8922f5da9b93" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce49cf59-80db-4e3e-b186-09e4c775ac4e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:49 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93
Jul 23 03:31:49 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:49 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93" returned: 0 in 0.391s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:49 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93
Jul 23 03:31:49 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:49 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-86d4400c-dab6-4e26-8fa9-8922f5da9b93" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-86d4400c-dab6-4e26-8fa9-8922f5da9b93" released by "delete_volume" :: held 0.740s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['68031c03-8a38-4cc4-bd7a-804a61517799', 'b677fc68-8ce9-4364-834b-32d99bfc38ea', '916a80f1-8d6a-4b65-801a-de4462cd1e90', '8569e3c7-f705-4ef8-8b5d-c19d9edcccb9'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:50 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:50 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:50 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleted volume successfully.
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4778960-c66f-49ff-bbc2-7c2c9507458b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9d2d6825-c7d9-46dc-b210-7976b8be7b8b tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-86d4400c-dab6-4e26-8fa9-8922f5da9b93-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:50 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe
Jul 23 03:31:50 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:50 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe" returned: 0 in 0.408s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:50 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe
Jul 23 03:31:50 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:51 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe" returned: 0 in 0.309s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe" released by "delete_volume" :: held 0.782s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['f75c4d4f-e3be-4fcb-84cb-1e71fefc9158', 'b99cad15-842f-421a-a5d3-ab9da9887251', 'fee69c0a-940f-48c8-bef2-386c81eb3980', '4db8f767-30b2-4ae7-b414-9b4127f670dd'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:51 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:51 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:51 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleted volume successfully.
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4b0d492a-d582-4847-baa1-d091f11f8eb1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-6b4d7c41-dec3-4edd-86b4-f50c803f3bbe-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222460d-3021-4964-ab43-a5ada2ef4cc1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:51 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c
Jul 23 03:31:51 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:52 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c" returned: 0 in 0.382s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:52 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c
Jul 23 03:31:52 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:52 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c" returned: 0 in 0.330s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c" released by "delete_volume" :: held 0.765s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['794a2c00-2cd6-4fc4-84e8-a78ccb75ef95', '3c60d664-4e45-410d-a9c6-8b0e5b502af6', 'fd3b1357-231a-4431-981a-c48425819bc7', 'dbd2e031-2d7e-491f-9982-20958574ed8d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:52 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:52 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-6981c8c6-b963-4260-9c2c-4cd9b960a3c6-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-6981c8c6-b963-4260-9c2c-4cd9b960a3c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-6981c8c6-b963-4260-9c2c-4cd9b960a3c6" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-6981c8c6-b963-4260-9c2c-4cd9b960a3c6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleting offline snapshot 6981c8c6-b963-4260-9c2c-4cd9b960a3c6 of volume dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] snapshot_file for this snap is: volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:31:52 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.289s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:52 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleted volume successfully.
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36537a2-7422-49f5-900c-124eb32e169a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1ac20596-fd6c-4cc9-9a79-1410968cb0f1 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-7ce3c117-20fd-4d5a-8d74-e4d1775a0d9c-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:53 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6
Jul 23 03:31:53 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:53 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:31:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed51567-df34-467b-a433-59283e753a54]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:53 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d
Jul 23 03:31:53 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:53 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" returned: 0 in 0.431s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:53 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6
Jul 23 03:31:53 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:54 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6" returned: 0 in 0.375s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:54 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6
Jul 23 03:31:54 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:54 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d.6981c8c6-b963-4260-9c2c-4cd9b960a3c6" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-6981c8c6-b963-4260-9c2c-4cd9b960a3c6" released by "_delete_snapshot" :: held 1.549s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" released by "delete_snapshot" :: held 1.575s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['9f7df6b5-0fec-4cc9-a9cf-37124e78d15b', '3a413601-4870-4471-af4f-118c9245c2b5', '94c023e6-c7fe-4414-bdd1-396d30cfd168', 'edcd446a-0e69-4da4-af3e-e39ee4ca8e54'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Delete snapshot completed successfully.
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-d84bd60c-d20d-4112-8e9b-58646cbe5521 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-6981c8c6-b963-4260-9c2c-4cd9b960a3c6-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-dbc1ab68-a16c-46dd-8ae0-a37f1442801d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-dbc1ab68-a16c-46dd-8ae0-a37f1442801d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "cinder-quobyte-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[421d68c4-8324-454a-bbad-f1cd8cdb4dfb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:55 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d
Jul 23 03:31:55 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:55 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" returned: 0 in 0.370s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:55 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d
Jul 23 03:31:55 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:55 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" returned: 0 in 0.250s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-quobyte-dbc1ab68-a16c-46dd-8ae0-a37f1442801d" released by "delete_volume" :: held 0.690s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Created reservations ['1b74f432-ed55-47dc-b056-26ee6dd870b4', 'b62fb72e-62b1-46e3-ab44-31d33c4b23ff', '198802f7-d047-4b50-987f-07513abd3e70', '323e5564-c6a5-4cf2-8b25-ff579884743b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:55 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:55 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:56 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.250s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:56 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:56 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Deleted volume successfully.
Jul 23 03:31:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-08df07f9-511d-4444-80ea-4220492ce368 tempest-CreateVolumesFromSnapshotTest-413943052 None] Lock "cinder-dbc1ab68-a16c-46dd-8ae0-a37f1442801d-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:31:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:31:58 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:31:58 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:31:59 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Jul 23 03:31:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:31:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:31:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:31:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:31:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Flow 'volume_create_manager' (9db0bf5e-f35c-4f2c-8a21-0a2e294281a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337ea11a-fa2d-43f2-a064-5a1a06d831f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337ea11a-fa2d-43f2-a064-5a1a06d831f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c56aebf-c64c-45ab-9271-afd8eda895ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2209e39e22e64e9784f50a3267315492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:01Z,use_quota=True,user_id='dc51dd4025464346b586843eba3a102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56a2bc3-7c60-4b37-9b56-34927f189dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56a2bc3-7c60-4b37-9b56-34927f189dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f282495-31b9-4b13-93db-f56c254405a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f282495-31b9-4b13-93db-f56c254405a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c56aebf-c64c-45ab-9271-afd8eda895ef', 'volume_name': 'volume-9c56aebf-c64c-45ab-9271-afd8eda895ef', 'volume_size': 1, 'image_id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19bfce85-3581-4310-b1c4-b4a908f82bc3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f212f3e6644fd4d92beeaf8820d571', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2209e39e22e64e9784f50a3267315492', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5bfb1b2d51cf627714fef764e2ca255209b5e5f1ece113a834ce6a4805166189f7d64525976a8c03164a537abb55ce389e02887467177b7aaf9288724f0466d5', 'id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'created_at': datetime.datetime(2026, 7, 23, 1, 31, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19bfce85-3581-4310-b1c4-b4a908f82bc3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f3e8410>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c698aeb-3a2d-4f0f-b40f-a2a4c6d1b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c698aeb-3a2d-4f0f-b40f-a2a4c6d1b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b264d48-548d-4f70-9732-e6e9531e5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Volume 9c56aebf-c64c-45ab-9271-afd8eda895ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c56aebf-c64c-45ab-9271-afd8eda895ef', 'volume_size': 1, 'image_id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19bfce85-3581-4310-b1c4-b4a908f82bc3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f212f3e6644fd4d92beeaf8820d571', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2209e39e22e64e9784f50a3267315492', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5bfb1b2d51cf627714fef764e2ca255209b5e5f1ece113a834ce6a4805166189f7d64525976a8c03164a537abb55ce389e02887467177b7aaf9288724f0466d5', 'id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'created_at': datetime.datetime(2026, 7, 23, 1, 31, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19bfce85-3581-4310-b1c4-b4a908f82bc3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f3e8410>}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Trying to clone 9c56aebf-c64c-45ab-9271-afd8eda895ef from image 19bfce85-3581-4310-b1c4-b4a908f82bc3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19bfce85-3581-4310-b1c4-b4a908f82bc3', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:32:01 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Image download 0.00 MB at 0.00 MB/s
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abbfbd3-1175-493e-9909-274ea056694c]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:02 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD
Jul 23 03:32:02 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:02 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:02 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD
Jul 23 03:32:02 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:02 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Temporary image 19bfce85-3581-4310-b1c4-b4a908f82bc3 is fetched for user dc51dd4025464346b586843eba3a102d. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[20821dc4-9c96-4fe3-b424-277fbc853eb2]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:02 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD
Jul 23 03:32:02 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:03 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:03 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD
Jul 23 03:32:03 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:03 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c56aebf-c64c-45ab-9271-afd8eda895ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2209e39e22e64e9784f50a3267315492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:01Z,use_quota=True,user_id='dc51dd4025464346b586843eba3a102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Creating volume 9c56aebf-c64c-45ab-9271-afd8eda895ef {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:03 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:03 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef 1073741824
Jul 23 03:32:03 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Flow 'volume_create_manager' (c0c3757c-4818-4ec8-8bf3-2af39a0674a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d06df0e-6646-4243-9f5d-074707d0d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:03 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d06df0e-6646-4243-9f5d-074707d0d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1254808758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc7cb1b-fe94-4113-aba5-9842777792ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76fde31a6554b5587e7d92870d75a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:04Z,use_quota=True,user_id='8d51630b2871446791ff5a91ce2d0c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfe98a6-ba57-4c01-9560-458681283cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfe98a6-ba57-4c01-9560-458681283cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7d1480-ae20-4b47-9871-1c44fc5f8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7d1480-ae20-4b47-9871-1c44fc5f8378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc7cb1b-fe94-4113-aba5-9842777792ea', 'volume_name': 'volume-bbc7cb1b-fe94-4113-aba5-9842777792ea', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7325c511-5c32-4b5e-b038-be54832b969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7325c511-5c32-4b5e-b038-be54832b969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5a758-a8e5-4b05-8d4d-6221cd287215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:03 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Volume bbc7cb1b-fe94-4113-aba5-9842777792ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc7cb1b-fe94-4113-aba5-9842777792ea', 'volume_size': 1}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef 1073741824" returned: 0 in 0.476s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:03 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef
Jul 23 03:32:03 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:04 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef" returned: 0 in 0.240s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1254808758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc7cb1b-fe94-4113-aba5-9842777792ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76fde31a6554b5587e7d92870d75a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:04Z,use_quota=True,user_id='8d51630b2871446791ff5a91ce2d0c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Creating volume bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:04 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:04 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea 1073741824
Jul 23 03:32:04 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Attempting download of 19bfce85-3581-4310-b1c4-b4a908f82bc3 ((None, [{'url': 'file:///opt/stack/data/glance/images/19bfce85-3581-4310-b1c4-b4a908f82bc3', 'metadata': {}}])) to volume 9c56aebf-c64c-45ab-9271-afd8eda895ef. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a87226-efa2-42e0-8ff2-16dae48c419c]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_ {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:04 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_
Jul 23 03:32:04 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:04 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:04 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea 1073741824" returned: 0 in 0.399s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_" returned: 0 in 0.337s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_ {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:04 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:04 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:04 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_
Jul 23 03:32:04 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:04 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.249s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b5a758-a8e5-4b05-8d4d-6221cd287215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc7cb1b-fe94-4113-aba5-9842777792ea', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea1d341-462e-4302-be6f-cb139cc3d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:04 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_" returned: 1 in 0.336s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19bfce85-3581-4310-b1c4-b4a908f82bc3_7ah6m3v_' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9000cb21-7418-4a6b-8cf8-954f8ba95147]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:04 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Volume volume-bbc7cb1b-fe94-4113-aba5-9842777792ea (bbc7cb1b-fe94-4113-aba5-9842777792ea): created successfully
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea1d341-462e-4302-be6f-cb139cc3d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Flow 'volume_create_manager' (c0c3757c-4818-4ec8-8bf3-2af39a0674a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:04 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-18491032-cec2-49a6-836e-c918efa93aa8 tempest-SnapshotDependencyTests-1776813972 None] Created volume successfully.
Jul 23 03:32:05 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD
Jul 23 03:32:05 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:05 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:05 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD
Jul 23 03:32:05 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:05 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD" returned: 1 in 0.303s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:05 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] 19bfce85-3581-4310-b1c4-b4a908f82bc3 was raw, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:32:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:05 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef
Jul 23 03:32:05 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:06 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef" returned: 0 in 0.444s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19bfce85-3581-4310-b1c4-b4a908f82bc3_0qgjwl1hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:32:06 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Converted 0.00 MB image at 0.00 MB/s
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:06 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef 1G
Jul 23 03:32:06 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Creating offline snapshot d2135063-e6e8-4dbc-b383-c96865e66cc3 of volume bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc54ca0-569e-4603-aad2-7144079dbb85]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:06 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:06 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:06 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef 1G" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Downloaded image 19bfce85-3581-4310-b1c4-b4a908f82bc3 ((None, [{'url': 'file:///opt/stack/data/glance/images/19bfce85-3581-4310-b1c4-b4a908f82bc3', 'metadata': {}}])) to volume 9c56aebf-c64c-45ab-9271-afd8eda895ef successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Temporary image 19bfce85-3581-4310-b1c4-b4a908f82bc3 for user dc51dd4025464346b586843eba3a102d is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Marking volume 9c56aebf-c64c-45ab-9271-afd8eda895ef as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Copying metadata from image 19bfce85-3581-4310-b1c4-b4a908f82bc3 to 9c56aebf-c64c-45ab-9271-afd8eda895ef. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Creating volume glance metadata for volume 9c56aebf-c64c-45ab-9271-afd8eda895ef backed by image 19bfce85-3581-4310-b1c4-b4a908f82bc3 with: {'image_id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '42f212f3e6644fd4d92beeaf8820d571', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b264d48-548d-4f70-9732-e6e9531e5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c56aebf-c64c-45ab-9271-afd8eda895ef', 'volume_size': 1, 'image_id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19bfce85-3581-4310-b1c4-b4a908f82bc3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f212f3e6644fd4d92beeaf8820d571', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2209e39e22e64e9784f50a3267315492', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5bfb1b2d51cf627714fef764e2ca255209b5e5f1ece113a834ce6a4805166189f7d64525976a8c03164a537abb55ce389e02887467177b7aaf9288724f0466d5', 'id': '19bfce85-3581-4310-b1c4-b4a908f82bc3', 'created_at': datetime.datetime(2026, 7, 23, 1, 31, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19bfce85-3581-4310-b1c4-b4a908f82bc3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f3e8410>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f421f558-148c-418b-a3bc-0a498b98760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:06 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Volume volume-9c56aebf-c64c-45ab-9271-afd8eda895ef (9c56aebf-c64c-45ab-9271-afd8eda895ef): created successfully
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f421f558-148c-418b-a3bc-0a498b98760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Flow 'volume_create_manager' (9db0bf5e-f35c-4f2c-8a21-0a2e294281a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:06 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2729e21f-eb98-4f80-aeed-1c65a0bb9205 tempest-VolumeImageDependencyTests-1011764260 None] Created volume successfully.
Jul 23 03:32:06 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.358s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:06 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 1G
Jul 23 03:32:06 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Acquiring lock "cinder-9c56aebf-c64c-45ab-9271-afd8eda895ef-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Lock "cinder-9c56aebf-c64c-45ab-9271-afd8eda895ef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Acquiring lock "cinder-quobyte-9c56aebf-c64c-45ab-9271-afd8eda895ef" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Lock "cinder-quobyte-9c56aebf-c64c-45ab-9271-afd8eda895ef" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e9d56-a8d8-4e4e-b515-afba0b45ae00]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:06 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 1G" returned: 0 in 0.407s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc7cb1b-fe94-4113-aba5-9842777792ea -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:06 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc7cb1b-fe94-4113-aba5-9842777792ea -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3
Jul 23 03:32:06 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef
Jul 23 03:32:07 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc7cb1b-fe94-4113-aba5-9842777792ea -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:07 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 is being set with open permissions: ugo+rw
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:07 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef" returned: 0 in 0.343s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:07 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3
Jul 23 03:32:07 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef
Jul 23 03:32:07 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3" returned: 0 in 0.237s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:INSERT=59,cinder:UPDATE=225,cinder:SELECT=163,cinder:DELETE=18 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=169,cinder:UPDATE=214,cinder:DELETE=19,cinder:INSERT=61 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:32:07 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9c56aebf-c64c-45ab-9271-afd8eda895ef" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Lock "cinder-quobyte-9c56aebf-c64c-45ab-9271-afd8eda895ef" released by "delete_volume" :: held 0.636s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:07 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info
Jul 23 03:32:07 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Created reservations ['d132c98d-ec99-46e7-a53d-73b8a7dd2159', '4fb5ed15-ca08-402e-be27-e1e71db67fb7', '3bd42a93-159b-414a-8778-c174b7faaf68', '9d6b6ab4-f8d5-49d7-a59f-55c60408e05c'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:07 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:07 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:07 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info is being set with open permissions: ugo+rw
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:07 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info
Jul 23 03:32:07 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:07 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Deleted volume successfully.
Jul 23 03:32:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0d9fadcc-d1ef-4df2-a825-eaa4bb36f0c3 tempest-VolumeImageDependencyTests-1011764260 None] Lock "cinder-9c56aebf-c64c-45ab-9271-afd8eda895ef-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:08 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.info" returned: 0 in 0.246s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-16b7f2aa-fe5e-481e-a620-87c12f9a74de tempest-SnapshotDependencyTests-1776813972 None] Create snapshot completed successfully
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Flow 'volume_create_manager' (ffd8cb89-5820-4400-b07b-9c294516a69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67286e49-14b5-425c-8a89-2dc96c376b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67286e49-14b5-425c-8a89-2dc96c376b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaf3763-48c4-4fa7-9a0c-0a7d933e8809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76fde31a6554b5587e7d92870d75a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2135063-e6e8-4dbc-b383-c96865e66cc3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:09Z,use_quota=True,user_id='8d51630b2871446791ff5a91ce2d0c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eac8c40-1e13-432f-9a2c-8bccda03b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eac8c40-1e13-432f-9a2c-8bccda03b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45205312-d3c6-4932-aaac-eb46fc3c5974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45205312-d3c6-4932-aaac-eb46fc3c5974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dbaf3763-48c4-4fa7-9a0c-0a7d933e8809', 'volume_name': 'volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809', 'volume_size': 1, 'snapshot_id': 'd2135063-e6e8-4dbc-b383-c96865e66cc3'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35532935-c8b1-44b6-acff-0f045227dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35532935-c8b1-44b6-acff-0f045227dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2092c3-7b8b-47ee-995b-2cb46a170aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:08 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Volume dbaf3763-48c4-4fa7-9a0c-0a7d933e8809: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809', 'volume_size': 1, 'snapshot_id': 'd2135063-e6e8-4dbc-b383-c96865e66cc3'}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-quobyte-d2135063-e6e8-4dbc-b383-c96865e66cc3-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-d2135063-e6e8-4dbc-b383-c96865e66cc3-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Creating volume dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 from snapshot d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-quobyte-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] snapshot: d2135063-e6e8-4dbc-b383-c96865e66cc3, volume: dbaf3763-48c4-4fa7-9a0c-0a7d933e8809,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a8aeb3-5829-4061-b1b3-b5d84def3e34]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:09 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3
Jul 23 03:32:09 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:09 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3" returned: 0 in 0.361s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc7cb1b-fe94-4113-aba5-9842777792ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af01d13-4957-4c1e-82a3-8f1e3b1f1de0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:09 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:09 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:09 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.366s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:32:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:09 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809
Jul 23 03:32:09 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:14 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" returned: 0 in 4.641s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:14 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37043e0-391d-4641-834e-55e722e0d829]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:14 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:14 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:14 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.517s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:14 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:32:14 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Converted 1024.00 MB image at 220.61 MB/s
Jul 23 03:32:14 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 is being set with open permissions: ugo+rw
Jul 23 03:32:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:14 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809
Jul 23 03:32:14 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:15 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" returned: 0 in 0.251s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" released by "_copy_volume_from_snapshot" :: held 6.231s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-d2135063-e6e8-4dbc-b383-c96865e66cc3-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" released by "_create_volume_from_snapshot" :: held 6.263s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.281s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2092c3-7b8b-47ee-995b-2cb46a170aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809', 'volume_size': 1, 'snapshot_id': 'd2135063-e6e8-4dbc-b383-c96865e66cc3'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74570847-31ed-46cd-bab7-e4d9560138a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:15 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Volume volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 (dbaf3763-48c4-4fa7-9a0c-0a7d933e8809): created successfully
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74570847-31ed-46cd-bab7-e4d9560138a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Flow 'volume_create_manager' (ffd8cb89-5820-4400-b07b-9c294516a69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a4ec788e-e73c-4ffa-8aab-67977208af51 tempest-SnapshotDependencyTests-1776813972 None] Created volume successfully.
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-d2135063-e6e8-4dbc-b383-c96865e66cc3-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-d2135063-e6e8-4dbc-b383-c96865e66cc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-quobyte-bbc7cb1b-fe94-4113-aba5-9842777792ea" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-bbc7cb1b-fe94-4113-aba5-9842777792ea" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-quobyte-d2135063-e6e8-4dbc-b383-c96865e66cc3" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-d2135063-e6e8-4dbc-b383-c96865e66cc3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Deleting offline snapshot d2135063-e6e8-4dbc-b383-c96865e66cc3 of volume bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] snapshot_file for this snap is: volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d96e7-c6dd-4336-8294-50d383e5058a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:15 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3
Jul 23 03:32:15 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:15 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3" returned: 0 in 0.382s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc7cb1b-fe94-4113-aba5-9842777792ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ffdce4-4885-40b9-9b92-84e645a2db8e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:16 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:16 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:16 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.404s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:16 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3
Jul 23 03:32:16 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:16 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3" returned: 0 in 0.372s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:16 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3
Jul 23 03:32:16 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:17 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea.d2135063-e6e8-4dbc-b383-c96865e66cc3" returned: 0 in 0.254s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-d2135063-e6e8-4dbc-b383-c96865e66cc3" released by "_delete_snapshot" :: held 1.526s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-bbc7cb1b-fe94-4113-aba5-9842777792ea" released by "delete_snapshot" :: held 1.552s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Created reservations ['89fe3b96-f209-4a17-8eed-819a0c5d369b', '3b081512-02ef-4210-a530-66dac2a7895b', 'f682a819-e989-4f8f-aa1a-7ad8b148e3a7', 'eeb907f1-3a60-441c-bb45-ccf3463ee76e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Delete snapshot completed successfully.
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8c80610a-3f6d-4283-93fa-199d92c9c04f tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-d2135063-e6e8-4dbc-b383-c96865e66cc3-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-bbc7cb1b-fe94-4113-aba5-9842777792ea-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-bbc7cb1b-fe94-4113-aba5-9842777792ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-quobyte-bbc7cb1b-fe94-4113-aba5-9842777792ea" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-bbc7cb1b-fe94-4113-aba5-9842777792ea" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf151e8c-409b-423b-9067-d0b6f0aac9da]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:17 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:17 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:18 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.403s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:18 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea
Jul 23 03:32:18 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:18 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bbc7cb1b-fe94-4113-aba5-9842777792ea" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-bbc7cb1b-fe94-4113-aba5-9842777792ea" released by "delete_volume" :: held 0.747s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Created reservations ['69cd44f4-b684-4ff3-a9f8-f344fdd73e19', '2e6cb2e9-15b1-4f65-b43c-a07100455f45', '6356a249-f2c8-4f49-b495-084dba309cf6', '50f8d2b6-ceb3-4270-883e-c92578e856f7'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:18 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:18 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:18 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.291s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Deleted volume successfully.
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1abb250e-bf99-4bb9-8e23-0292ece90116 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-bbc7cb1b-fe94-4113-aba5-9842777792ea-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "cinder-quobyte-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4fe8a4-297c-408b-bf5b-de96aa5fb4b1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:19 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809
Jul 23 03:32:19 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:19 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:19 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809
Jul 23 03:32:19 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:19 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-quobyte-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809" released by "delete_volume" :: held 0.662s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Created reservations ['72074dff-f49f-4057-8a79-68743184dc24', '3fab7a41-0056-4104-9974-bbfc64366f45', 'd13a5dde-c061-407a-ad74-c254b7899bd9', '759affd3-3f99-40dd-89c2-a62202ea3bb0'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:19 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:19 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:20 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.297s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:20 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Deleted volume successfully.
Jul 23 03:32:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-913b064b-e767-44d5-b766-9ad492094327 tempest-SnapshotDependencyTests-1776813972 None] Lock "cinder-dbaf3763-48c4-4fa7-9a0c-0a7d933e8809-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:29 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=6 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:32:30 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=27,cinder:UPDATE=35,cinder:INSERT=11,cinder:DELETE=3 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (2deaaaeb-3100-4385-ac33-dcedcb5f1a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb53e24-9e85-466f-9d0f-8ea5a1a8dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb53e24-9e85-466f-9d0f-8ea5a1a8dac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-376971201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca5c059-7e56-4ac2-91d3-1e5aea2ce354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:38Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe2b83-05f4-47e9-9e07-882f54e81b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe2b83-05f4-47e9-9e07-882f54e81b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c291b74-e127-4a8b-bd96-d45fc40f5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c291b74-e127-4a8b-bd96-d45fc40f5560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca5c059-7e56-4ac2-91d3-1e5aea2ce354', 'volume_name': 'volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95165587-90f6-49e0-9b0c-aaeb6f76ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95165587-90f6-49e0-9b0c-aaeb6f76ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc65cd2a-bf43-43e7-9fa1-5721911eebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Volume 8ca5c059-7e56-4ac2-91d3-1e5aea2ce354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354', 'volume_size': 1}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-376971201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca5c059-7e56-4ac2-91d3-1e5aea2ce354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:38Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Creating volume 8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:38 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:38 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 1073741824
Jul 23 03:32:38 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (a1767028-9a85-4b7e-87c4-626bc4cc487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859913b9-b4ad-4455-ba95-61dd86d21e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:38 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (32c9d64c-f397-45f6-9424-3cb02af9bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfe431-8f3d-404f-96a8-7fb5f92d86a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859913b9-b4ad-4455-ba95-61dd86d21e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659359586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c9c094-002d-4654-b588-a5ddba9159ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d4e5c0-f4c7-4577-a240-271ead17e600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d4e5c0-f4c7-4577-a240-271ead17e600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f9dafb-de9e-46aa-9bb6-b84132a9b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f9dafb-de9e-46aa-9bb6-b84132a9b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c9c094-002d-4654-b588-a5ddba9159ea', 'volume_name': 'volume-44c9c094-002d-4654-b588-a5ddba9159ea', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ef7912-a3c2-4985-84ba-267e46ce2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ef7912-a3c2-4985-84ba-267e46ce2516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083624a3-47da-4470-a25d-56d582fabcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume 44c9c094-002d-4654-b588-a5ddba9159ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c9c094-002d-4654-b588-a5ddba9159ea', 'volume_size': 1}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 1073741824" returned: 0 in 0.711s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfe431-8f3d-404f-96a8-7fb5f92d86a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1398098744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937266d3-f804-4b97-ab49-e70a52e4d2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34479595-a2a5-45bf-abcc-aaeb941798d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34479595-a2a5-45bf-abcc-aaeb941798d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c669e2-f8fb-4c94-a0f2-c03a9b616e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c669e2-f8fb-4c94-a0f2-c03a9b616e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937266d3-f804-4b97-ab49-e70a52e4d2e6', 'volume_name': 'volume-937266d3-f804-4b97-ab49-e70a52e4d2e6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9d6b16-cfc4-4c65-90c2-1636e35c6a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9d6b16-cfc4-4c65-90c2-1636e35c6a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efce838-6200-4a20-92da-fd09b4b086ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Volume 937266d3-f804-4b97-ab49-e70a52e4d2e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937266d3-f804-4b97-ab49-e70a52e4d2e6', 'volume_size': 1}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:39 devstack sudo[106285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354
Jul 23 03:32:39 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (d87b5f44-e893-445c-b7fa-2babcff4eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a15887-f9db-4100-afa6-037ef2bc5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a15887-f9db-4100-afa6-037ef2bc5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-559229006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7331979a-41fb-4c15-8afb-d907405f8c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e4e5e3-c8c4-4e06-8517-eb185bde3940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e4e5e3-c8c4-4e06-8517-eb185bde3940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab689685-cb1a-422c-b5d3-8d455297a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab689685-cb1a-422c-b5d3-8d455297a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7331979a-41fb-4c15-8afb-d907405f8c3a', 'volume_name': 'volume-7331979a-41fb-4c15-8afb-d907405f8c3a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad3c0ee-42d1-40c1-8af0-8c26577e7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad3c0ee-42d1-40c1-8af0-8c26577e7630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81820b4-ef25-4c6f-8124-a46397a996fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Volume 7331979a-41fb-4c15-8afb-d907405f8c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7331979a-41fb-4c15-8afb-d907405f8c3a', 'volume_size': 1}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:39 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354" returned: 0 in 0.428s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659359586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c9c094-002d-4654-b588-a5ddba9159ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating volume 44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc65cd2a-bf43-43e7-9fa1-5721911eebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3523a9c4-5a17-4c67-a0aa-c67856c3b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea 1073741824
Jul 23 03:32:39 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Volume volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 (8ca5c059-7e56-4ac2-91d3-1e5aea2ce354): created successfully
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3523a9c4-5a17-4c67-a0aa-c67856c3b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (2deaaaeb-3100-4385-ac33-dcedcb5f1a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-797e3b8b-c189-49ea-99a8-60662a3492e2 tempest-CreateVolumesFromImageTest-1145237749 None] Created volume successfully.
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (795a61cc-a79a-402f-a226-9de8f314c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1082a7c5-1427-4aba-bf63-bd3d2d18434b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1082a7c5-1427-4aba-bf63-bd3d2d18434b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1579178881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e058ef-e1e6-487b-8bac-e3bea8fbce7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0264cbc-cc59-425f-89b9-3c3fa34e1cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0264cbc-cc59-425f-89b9-3c3fa34e1cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e155bf8-d5eb-4146-8b04-c14bfa864f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e155bf8-d5eb-4146-8b04-c14bfa864f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e058ef-e1e6-487b-8bac-e3bea8fbce7a', 'volume_name': 'volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0746f7-510f-4802-a37c-30c289cf85f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0746f7-510f-4802-a37c-30c289cf85f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36197f57-567a-41ab-bdef-d9bc030e90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Volume 33e058ef-e1e6-487b-8bac-e3bea8fbce7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a', 'volume_size': 1}
Jul 23 03:32:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:40 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea 1073741824" returned: 0 in 0.760s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (84c0c1de-8693-4c21-88be-ceffb0d3769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d2e18d-b2e0-4318-955e-56afccc9e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d2e18d-b2e0-4318-955e-56afccc9e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868928029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b734823-dcea-49a3-b122-8925c33d54f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27356cc-aac0-4660-871e-f61ff1d42a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27356cc-aac0-4660-871e-f61ff1d42a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929549ee-e14b-4989-bfcd-27f508b12635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929549ee-e14b-4989-bfcd-27f508b12635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b734823-dcea-49a3-b122-8925c33d54f1', 'volume_name': 'volume-4b734823-dcea-49a3-b122-8925c33d54f1', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5669427-6adb-46da-81a0-1b00c617ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5669427-6adb-46da-81a0-1b00c617ef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14db9def-6189-4e88-8b3b-c95e0736b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Volume 4b734823-dcea-49a3-b122-8925c33d54f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b734823-dcea-49a3-b122-8925c33d54f1', 'volume_size': 1}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:40 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea
Jul 23 03:32:40 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:40 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea" returned: 0 in 0.247s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1398098744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937266d3-f804-4b97-ab49-e70a52e4d2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Creating volume 937266d3-f804-4b97-ab49-e70a52e4d2e6 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:40 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:40 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 1073741824
Jul 23 03:32:40 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083624a3-47da-4470-a25d-56d582fabcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c9c094-002d-4654-b588-a5ddba9159ea', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6897d5c3-cb85-4aef-8086-0a51ebd6a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume volume-44c9c094-002d-4654-b588-a5ddba9159ea (44c9c094-002d-4654-b588-a5ddba9159ea): created successfully
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6897d5c3-cb85-4aef-8086-0a51ebd6a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (a1767028-9a85-4b7e-87c4-626bc4cc487a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ccf25723-f5e3-4ace-8778-6c89605bf6d2 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created volume successfully.
Jul 23 03:32:41 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 1073741824" returned: 0 in 0.505s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:41 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6
Jul 23 03:32:41 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:41 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6" returned: 0 in 0.323s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.179s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-559229006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7331979a-41fb-4c15-8afb-d907405f8c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Creating volume 7331979a-41fb-4c15-8afb-d907405f8c3a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:41 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:41 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a 1073741824
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efce838-6200-4a20-92da-fd09b4b086ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937266d3-f804-4b97-ab49-e70a52e4d2e6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:41 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb8f03f-d1f7-4d23-a3d0-f101b280bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Volume volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 (937266d3-f804-4b97-ab49-e70a52e4d2e6): created successfully
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb8f03f-d1f7-4d23-a3d0-f101b280bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (32c9d64c-f397-45f6-9424-3cb02af9bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2753fc5e-cddf-442e-a946-9f9c3da02cf6 tempest-CreateVolumesFromImageTest-1145237749 None] Created volume successfully.
Jul 23 03:32:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Flow 'volume_create_manager' (51ba4b97-86a8-4ea2-b70b-643fe4f39933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0127aa-bcde-47c9-ac04-a0651b5f7d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0127aa-bcde-47c9-ac04-a0651b5f7d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a56204c-e7ca-44c7-a236-728b80db14ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51851caa644c4de684bd253968dda4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:42Z,use_quota=True,user_id='fa0f364f4fab48d29d4caf0b75859886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c2fa34-756b-45c1-abbb-4660af4c447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c2fa34-756b-45c1-abbb-4660af4c447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73778740-7cfd-49bd-905d-87f789df0838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:32:42 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a 1073741824" returned: 0 in 0.538s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:42 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a
Jul 23 03:32:42 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73778740-7cfd-49bd-905d-87f789df0838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a56204c-e7ca-44c7-a236-728b80db14ea', 'volume_name': 'volume-4a56204c-e7ca-44c7-a236-728b80db14ea', 'volume_size': 1, 'image_id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecaa522b745a6e9d725af2accb37ac2d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51851caa644c4de684bd253968dda4aa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38cde35b5a7462be01ce74a3f8f1f3c74d18e5ceb1d982a80616569a3e60393ec28963d34441979fd30173cefe41f5ee899ff204e449cfad1b78e2bd5d9574b1', 'id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f25c170>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa9c064-ad65-4aa0-b351-49319d73fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa9c064-ad65-4aa0-b351-49319d73fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ceab59-fc97-464f-acfe-ffd552b610d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Volume 4a56204c-e7ca-44c7-a236-728b80db14ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a56204c-e7ca-44c7-a236-728b80db14ea', 'volume_size': 1, 'image_id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecaa522b745a6e9d725af2accb37ac2d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51851caa644c4de684bd253968dda4aa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38cde35b5a7462be01ce74a3f8f1f3c74d18e5ceb1d982a80616569a3e60393ec28963d34441979fd30173cefe41f5ee899ff204e449cfad1b78e2bd5d9574b1', 'id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f25c170>}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Trying to clone 4a56204c-e7ca-44c7-a236-728b80db14ea from image 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:32:42 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a" returned: 0 in 0.286s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.580s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1579178881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e058ef-e1e6-487b-8bac-e3bea8fbce7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Creating volume 33e058ef-e1e6-487b-8bac-e3bea8fbce7a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:42 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:42 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a 1073741824
Jul 23 03:32:42 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81820b4-ef25-4c6f-8124-a46397a996fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7331979a-41fb-4c15-8afb-d907405f8c3a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4732271e-30c6-4b62-81e7-70b4c24f5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:32:42 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Image download 0.00 MB at 0.00 MB/s
Jul 23 03:32:42 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Volume volume-7331979a-41fb-4c15-8afb-d907405f8c3a (7331979a-41fb-4c15-8afb-d907405f8c3a): created successfully
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4732271e-30c6-4b62-81e7-70b4c24f5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (d87b5f44-e893-445c-b7fa-2babcff4eef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d209a9e8-cea5-42e4-9a86-9f30fb8a192e tempest-CreateVolumesFromImageTest-1145237749 None] Created volume successfully.
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc40d7f-eace-48ed-b978-522cfcd797c4]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:42 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD
Jul 23 03:32:42 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Flow 'volume_create_manager' (241e649d-d045-40bb-983e-d0b34ded7b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096946fa-9608-45bd-b8f2-df253e37ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096946fa-9608-45bd-b8f2-df253e37ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad2e900-d669-4cc8-b922-c9145868c1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d244192a8f74b00b0cc21b0dc6e5304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:43Z,use_quota=True,user_id='88ac3699d55844b8ba396325f861df77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e02369-f70b-4786-96ef-b774583b90af),volume_type_id=51e02369-f70b-4786-96ef-b774583b90af)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddfa0ea-c6de-4b24-b413-7dce23cc110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddfa0ea-c6de-4b24-b413-7dce23cc110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1906e420-636a-4682-b781-b6f91653b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:42 devstack cinder-volume[88344]: DEBUG cinder.image.glance [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Creating Keystone auth plugin from conf {{(pid=88344) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 23 03:32:43 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a 1073741824" returned: 0 in 0.506s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a
Jul 23 03:32:43 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD
Jul 23 03:32:43 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1906e420-636a-4682-b781-b6f91653b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dad2e900-d669-4cc8-b922-c9145868c1ba', 'volume_name': 'volume-dad2e900-d669-4cc8-b922-c9145868c1ba', 'volume_size': 1, 'image_id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73b6437f73081a37ebea523e9ff8f7d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d244192a8f74b00b0cc21b0dc6e5304', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a0a0b64adb50228e1e2b96f1427c790e94b33a0aa77c338d5b57334639fbdcf3f270c961831642417df641c803cefd8ad48d658a0b50250c0d0f748839d2823', 'id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736934f32c00>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbeb3ee-0a4a-4b7d-9aed-05d506ff4ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbeb3ee-0a4a-4b7d-9aed-05d506ff4ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c7de27-2b83-4fb7-a404-8a4410f27ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Volume dad2e900-d669-4cc8-b922-c9145868c1ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dad2e900-d669-4cc8-b922-c9145868c1ba', 'volume_size': 1, 'image_id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73b6437f73081a37ebea523e9ff8f7d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d244192a8f74b00b0cc21b0dc6e5304', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a0a0b64adb50228e1e2b96f1427c790e94b33a0aa77c338d5b57334639fbdcf3f270c961831642417df641c803cefd8ad48d658a0b50250c0d0f748839d2823', 'id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736934f32c00>}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Trying to clone dad2e900-d669-4cc8-b922-c9145868c1ba from image aa28f45d-62d9-4b8b-aed3-77598abd43b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'metadata': {}}]). {{(pid=88344) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 23 03:32:43 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Image download 0.00 MB at 0.00 MB/s
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baeb12d-f45f-4fb1-89a0-6ba3b29817fe]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868928029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b734823-dcea-49a3-b122-8925c33d54f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c68fcacd07844f1ac48006e12165195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='e9b9b997db7e4242a0caff58f095c0d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Creating volume 4b734823-dcea-49a3-b122-8925c33d54f1 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:43 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:43 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Temporary image 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 is fetched for user fa0f364f4fab48d29d4caf0b75859886. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:32:43 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1 1073741824
Jul 23 03:32:43 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36197f57-567a-41ab-bdef-d9bc030e90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7269d647-a9e8-4b56-8275-117e3a65af70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Volume volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a (33e058ef-e1e6-487b-8bac-e3bea8fbce7a): created successfully
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7269d647-a9e8-4b56-8275-117e3a65af70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (795a61cc-a79a-402f-a226-9de8f314c45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:43 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD
Jul 23 03:32:43 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-bdb4b1a2-e5b1-49a4-973a-c9310b8b46b3 tempest-CreateVolumesFromImageTest-1145237749 None] Created volume successfully.
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6afa4c-2d8b-4e6a-a6a3-3ce0b4bb4187]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD
Jul 23 03:32:43 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD
Jul 23 03:32:43 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1 1073741824" returned: 0 in 0.506s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:43 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1
Jul 23 03:32:43 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD
Jul 23 03:32:43 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:43 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:44 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Temporary image aa28f45d-62d9-4b8b-aed3-77598abd43b5 is fetched for user 88ac3699d55844b8ba396325f861df77. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4f897-b9a3-416b-8cac-ee13aed46006]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:44 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:44 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.295s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14db9def-6189-4e88-8b3b-c95e0736b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b734823-dcea-49a3-b122-8925c33d54f1', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccb781e-645b-44be-9470-645756c09ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:44 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD
Jul 23 03:32:44 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating offline snapshot 6e67b04b-1aac-4a2b-891b-eb91358454ee of volume 44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:32:44 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Volume volume-4b734823-dcea-49a3-b122-8925c33d54f1 (4b734823-dcea-49a3-b122-8925c33d54f1): created successfully
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccb781e-645b-44be-9470-645756c09ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Flow 'volume_create_manager' (84c0c1de-8693-4c21-88be-ceffb0d3769d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c18a6-6709-468f-9090-a3f2cedba31b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6bf11b48-1681-4cc4-bc21-bf7dddf7d73c tempest-CreateVolumesFromImageTest-1145237749 None] Created volume successfully.
Jul 23 03:32:44 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea
Jul 23 03:32:44 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:44 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:44 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD
Jul 23 03:32:44 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:44 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea" returned: 0 in 0.375s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:44 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee 1G
Jul 23 03:32:44 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:44 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-4b734823-dcea-49a3-b122-8925c33d54f1-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-4b734823-dcea-49a3-b122-8925c33d54f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-quobyte-4b734823-dcea-49a3-b122-8925c33d54f1" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-4b734823-dcea-49a3-b122-8925c33d54f1" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6970a23-ac4d-4a0a-a6b3-6f792eace050]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee 1G" returned: 0 in 0.434s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c9c094-002d-4654-b588-a5ddba9159ea -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c9c094-002d-4654-b588-a5ddba9159ea -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee
Jul 23 03:32:45 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:45 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1
Jul 23 03:32:45 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:45 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c9c094-002d-4654-b588-a5ddba9159ea -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:45 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee is being set with open permissions: ugo+rw
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee
Jul 23 03:32:45 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:45 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1
Jul 23 03:32:45 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:45 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee" returned: 0 in 0.228s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:45 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4b734823-dcea-49a3-b122-8925c33d54f1" returned: 0 in 0.240s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-4b734823-dcea-49a3-b122-8925c33d54f1" released by "delete_volume" :: held 0.641s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:45 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info
Jul 23 03:32:45 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Created reservations ['f3ffd951-f39b-4346-be1a-e79d0e913ac5', '21e56b17-0204-4523-b434-2234528436e6', 'aeb031ff-2dbc-43f2-8b47-68582d62594e', 'd689c67a-15ff-4174-abb6-4dd407c56b41'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:45 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:45 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:45 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info is being set with open permissions: ugo+rw
Jul 23 03:32:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:45 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info
Jul 23 03:32:45 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:46 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Deleted volume successfully.
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-817fa76f-d96f-4016-abfe-b0082914ad64 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-4b734823-dcea-49a3-b122-8925c33d54f1-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-33e058ef-e1e6-487b-8bac-e3bea8fbce7a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-33e058ef-e1e6-487b-8bac-e3bea8fbce7a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:46 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-quobyte-33e058ef-e1e6-487b-8bac-e3bea8fbce7a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.info" returned: 0 in 0.289s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a56204c-e7ca-44c7-a236-728b80db14ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51851caa644c4de684bd253968dda4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:42Z,use_quota=True,user_id='fa0f364f4fab48d29d4caf0b75859886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Creating volume 4a56204c-e7ca-44c7-a236-728b80db14ea {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:46 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:46 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea 1073741824
Jul 23 03:32:46 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-33e058ef-e1e6-487b-8bac-e3bea8fbce7a" acquired by "delete_volume" :: waited 0.068s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:46 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3fab1c41-2222-4c80-8975-0611042f9d6a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Create snapshot completed successfully
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac1e80-4285-4849-b5a2-c3288a2845e5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:46 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a
Jul 23 03:32:46 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:46 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea 1073741824" returned: 0 in 0.406s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:46 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a" returned: 0 in 0.349s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:46 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a
Jul 23 03:32:46 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:46 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea
Jul 23 03:32:46 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:46 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-33e058ef-e1e6-487b-8bac-e3bea8fbce7a" returned: 0 in 0.236s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-33e058ef-e1e6-487b-8bac-e3bea8fbce7a" released by "delete_volume" :: held 0.635s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:46 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad2e900-d669-4cc8-b922-c9145868c1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d244192a8f74b00b0cc21b0dc6e5304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:43Z,use_quota=True,user_id='88ac3699d55844b8ba396325f861df77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51e02369-f70b-4786-96ef-b774583b90af),volume_type_id=51e02369-f70b-4786-96ef-b774583b90af)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Creating volume dad2e900-d669-4cc8-b922-c9145868c1ba {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:46 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:46 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba 1073741824
Jul 23 03:32:46 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Created reservations ['9d6efd3b-af4b-4858-997b-8a0a7ab5730d', '16552741-c269-4963-9307-e7b2f1da5636', 'f25f8384-d51e-4065-8b9d-73989e8b98fc', 'a683935a-95f6-4d2f-af2c-b337ce9ce281'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:46 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Attempting download of 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'metadata': {}}])) to volume 4a56204c-e7ca-44c7-a236-728b80db14ea. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc713e6-17d3-40b1-a117-16169df5a433]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:47 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:47 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:47 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq
Jul 23 03:32:47 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-7331979a-41fb-4c15-8afb-d907405f8c3a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-7331979a-41fb-4c15-8afb-d907405f8c3a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-quobyte-7331979a-41fb-4c15-8afb-d907405f8c3a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-7331979a-41fb-4c15-8afb-d907405f8c3a" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:47 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.358s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcce20e-1b2e-49f7-b164-680da76a3c87]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Deleted volume successfully.
Jul 23 03:32:47 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba 1073741824" returned: 0 in 0.588s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-65a914f8-7387-41e1-b04a-d55769e7b54b tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-33e058ef-e1e6-487b-8bac-e3bea8fbce7a-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:47 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq" returned: 0 in 0.499s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:47 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba
Jul 23 03:32:47 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:47 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a
Jul 23 03:32:47 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:47 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq
Jul 23 03:32:47 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (53f7ddf4-553c-4f30-b16d-7c8f481a31c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194f83ae-33c3-42d7-875f-7d0a1fc4580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194f83ae-33c3-42d7-875f-7d0a1fc4580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839753976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:48Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8a358d-c521-4dbc-9d9a-dfa45ecedaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8a358d-c521-4dbc-9d9a-dfa45ecedaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf6fbc2-4d28-4f45-86c7-995b3e157e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf6fbc2-4d28-4f45-86c7-995b3e157e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc', 'volume_name': 'volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c810cb2-de21-4177-91db-2a6acfff86ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c810cb2-de21-4177-91db-2a6acfff86ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a5d7cf-55a1-4c5c-8a80-af4aebe4369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:47 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc', 'volume_size': 1}
Jul 23 03:32:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:48 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq" returned: 1 in 0.489s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_cki4wkgq' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba" returned: 0 in 0.462s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4b510c-eead-4681-a82c-903d7e804f73]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839753976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:48Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating volume b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:48 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc 1073741824
Jul 23 03:32:48 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a" returned: 0 in 0.631s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Attempting download of aa28f45d-62d9-4b8b-aed3-77598abd43b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'metadata': {}}])) to volume dad2e900-d669-4cc8-b922-c9145868c1ba. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 23 03:32:48 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a
Jul 23 03:32:48 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[692fc228-e35e-4806-b4d7-14e444fc88cb]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:48 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD
Jul 23 03:32:48 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (f75d283a-9249-4c02-93f2-d002de430460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289c9508-a0ad-43cf-a453-57f8066edf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289c9508-a0ad-43cf-a453-57f8066edf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1916004441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96b8b80-2025-45a1-a12a-7943c9ba3460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:48Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda757dd-c706-4358-8290-c0bc844ac68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda757dd-c706-4358-8290-c0bc844ac68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a8015f-3b07-4c47-80dd-a684f3de9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a8015f-3b07-4c47-80dd-a684f3de9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96b8b80-2025-45a1-a12a-7943c9ba3460', 'volume_name': 'volume-d96b8b80-2025-45a1-a12a-7943c9ba3460', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e8d442-0b34-4986-a4cc-c8abc916aef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e8d442-0b34-4986-a4cc-c8abc916aef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d06d63-f7ff-4bf3-847a-0f1704a462e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume d96b8b80-2025-45a1-a12a-7943c9ba3460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96b8b80-2025-45a1-a12a-7943c9ba3460', 'volume_size': 1}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:48 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj
Jul 23 03:32:48 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:48 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7331979a-41fb-4c15-8afb-d907405f8c3a" returned: 0 in 0.516s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-7331979a-41fb-4c15-8afb-d907405f8c3a" released by "delete_volume" :: held 1.218s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Created reservations ['c16ee4be-5c57-4303-9b0a-e0a8110525b6', '6071c0fc-f85b-41c8-884c-66f9f1e21db8', 'a6897a4a-82ed-44b8-a299-ccd63682fd4a', '01031526-f28d-4f40-a672-ce2037c935f7'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:48 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (61ea65bf-b1f6-4ce4-9c64-95e6aa63c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f9a1da-9f4a-4872-bc0b-3a782bdcd908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc 1073741824" returned: 0 in 0.783s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:48 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD
Jul 23 03:32:48 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj" returned: 0 in 0.603s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f9a1da-9f4a-4872-bc0b-3a782bdcd908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-175822541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacd1595-8516-42b5-b4a1-340f9af7181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:49Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8a04ef-3330-4ed6-b3a3-19f17989c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8a04ef-3330-4ed6-b3a3-19f17989c095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c7b9f9-4dc5-4e21-9158-1f41bd57ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c7b9f9-4dc5-4e21-9158-1f41bd57ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dacd1595-8516-42b5-b4a1-340f9af7181e', 'volume_name': 'volume-dacd1595-8516-42b5-b4a1-340f9af7181e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526d3697-397a-4db8-a36e-4f915ab4e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526d3697-397a-4db8-a36e-4f915ab4e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f463080-01f3-46b3-816d-d387977ad3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:48 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume dacd1595-8516-42b5-b4a1-340f9af7181e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dacd1595-8516-42b5-b4a1-340f9af7181e', 'volume_size': 1}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:48 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc
Jul 23 03:32:48 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:49 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj
Jul 23 03:32:49 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:49 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:49 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:49 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD" returned: 1 in 0.614s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 was raw, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:49 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea
Jul 23 03:32:49 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:49 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (b44b69a2-7161-428e-9a04-b01913660f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730221b7-1aba-45e7-adcc-ae8ada4e390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj" returned: 1 in 0.524s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa28f45d-62d9-4b8b-aed3-77598abd43b5_961946jj' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab5335-6a18-4f36-b305-80532f571df9]: (4, 'raw') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:49 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730221b7-1aba-45e7-adcc-ae8ada4e390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1502062281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14e72d2-8674-41f0-968d-dc88eea03719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:49Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc7013b-c58e-41ed-b32d-9f7d4aec6dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc7013b-c58e-41ed-b32d-9f7d4aec6dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52736eb-8b22-4c5b-b4fe-3862e5ae37e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:49 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52736eb-8b22-4c5b-b4fe-3862e5ae37e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14e72d2-8674-41f0-968d-dc88eea03719', 'volume_name': 'volume-f14e72d2-8674-41f0-968d-dc88eea03719', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a750cb6c-90aa-48ca-bc1e-8d6513720154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a750cb6c-90aa-48ca-bc1e-8d6513720154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff57cba1-d839-45cb-94e3-76425fe43b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:49 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume f14e72d2-8674-41f0-968d-dc88eea03719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14e72d2-8674-41f0-968d-dc88eea03719', 'volume_size': 1}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc" returned: 0 in 0.529s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1916004441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96b8b80-2025-45a1-a12a-7943c9ba3460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:48Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating volume d96b8b80-2025-45a1-a12a-7943c9ba3460 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:49 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.479s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:49 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Deleted volume successfully.
Jul 23 03:32:49 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 1073741824
Jul 23 03:32:49 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a5d7cf-55a1-4c5c-8a80-af4aebe4369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa36842-6443-4863-8032-49bf3f516ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:49 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc (b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc): created successfully
Jul 23 03:32:49 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD
Jul 23 03:32:49 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa36842-6443-4863-8032-49bf3f516ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (53f7ddf4-553c-4f30-b16d-7c8f481a31c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-22f385cf-1650-41e7-befe-39d813bf88e8 tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-7331979a-41fb-4c15-8afb-d907405f8c3a-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:49 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0b0d3467-10ce-4ec0-88f0-da1aa5b6f675 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created volume successfully.
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-937266d3-f804-4b97-ab49-e70a52e4d2e6-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-937266d3-f804-4b97-ab49-e70a52e4d2e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-quobyte-937266d3-f804-4b97-ab49-e70a52e4d2e6" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-937266d3-f804-4b97-ab49-e70a52e4d2e6" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3551f-0e24-4a0c-b010-62e68173bccc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:49 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea" returned: 0 in 0.746s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9_qa8q43rodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Converted 0.00 MB image at 0.00 MB/s
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6
Jul 23 03:32:50 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD
Jul 23 03:32:50 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea 1G
Jul 23 03:32:50 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 1073741824" returned: 0 in 0.677s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460
Jul 23 03:32:50 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (09d2cf96-d24a-4366-af3f-3e79f9daad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b36b42-bcc3-4377-b4cf-91fca66c24a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b36b42-bcc3-4377-b4cf-91fca66c24a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894275167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b570af73-43d1-4625-a2b8-debb979ec457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:50Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110a68a-8b91-40c9-af66-303600c255a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110a68a-8b91-40c9-af66-303600c255a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289e6107-75ec-4840-9bcb-9c68b1777aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289e6107-75ec-4840-9bcb-9c68b1777aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b570af73-43d1-4625-a2b8-debb979ec457', 'volume_name': 'volume-b570af73-43d1-4625-a2b8-debb979ec457', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4838aaf-43bd-49bd-bcb6-6e712e3b4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4838aaf-43bd-49bd-bcb6-6e712e3b4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676624de-3ced-4655-af46-b09ea3f32966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume b570af73-43d1-4625-a2b8-debb979ec457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b570af73-43d1-4625-a2b8-debb979ec457', 'volume_size': 1}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD" returned: 1 in 0.592s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD' failed. Not Retrying. {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6" returned: 0 in 0.619s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] aa28f45d-62d9-4b8b-aed3-77598abd43b5 was raw, converting to qcow2 {{(pid=88344) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea 1G" returned: 0 in 0.473s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Downloaded image 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'metadata': {}}])) to volume 4a56204c-e7ca-44c7-a236-728b80db14ea successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Temporary image 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 for user fa0f364f4fab48d29d4caf0b75859886 is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Marking volume 4a56204c-e7ca-44c7-a236-728b80db14ea as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:32:50 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba
Jul 23 03:32:50 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Copying metadata from image 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 to 4a56204c-e7ca-44c7-a236-728b80db14ea. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Creating volume glance metadata for volume 4a56204c-e7ca-44c7-a236-728b80db14ea backed by image 96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9 with: {'image_id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ecaa522b745a6e9d725af2accb37ac2d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:32:50 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460" returned: 0 in 0.322s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-175822541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacd1595-8516-42b5-b4a1-340f9af7181e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:49Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating volume dacd1595-8516-42b5-b4a1-340f9af7181e {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d06d63-f7ff-4bf3-847a-0f1704a462e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96b8b80-2025-45a1-a12a-7943c9ba3460', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd23f0cf-2987-4cf6-8b14-d1e28e3b62c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e 1073741824
Jul 23 03:32:50 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 (d96b8b80-2025-45a1-a12a-7943c9ba3460): created successfully
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd23f0cf-2987-4cf6-8b14-d1e28e3b62c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (f75d283a-9249-4c02-93f2-d002de430460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ceab59-fc97-464f-acfe-ffd552b610d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a56204c-e7ca-44c7-a236-728b80db14ea', 'volume_size': 1, 'image_id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecaa522b745a6e9d725af2accb37ac2d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '51851caa644c4de684bd253968dda4aa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38cde35b5a7462be01ce74a3f8f1f3c74d18e5ceb1d982a80616569a3e60393ec28963d34441979fd30173cefe41f5ee899ff204e449cfad1b78e2bd5d9574b1', 'id': '96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96de276b-8ff7-4cd6-a0df-a2f79cd7b6b9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73693f25c170>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bed0d4f-6876-497f-9e3b-09abfb919f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Volume volume-4a56204c-e7ca-44c7-a236-728b80db14ea (4a56204c-e7ca-44c7-a236-728b80db14ea): created successfully
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bed0d4f-6876-497f-9e3b-09abfb919f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Flow 'volume_create_manager' (51ba4b97-86a8-4ea2-b70b-643fe4f39933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b15a131a-1a03-40e1-a2a1-f864e18cc728 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created volume successfully.
Jul 23 03:32:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f5b5d766-172c-4a8d-9948-ecbdbd4379c6 tempest-VolumeImageDependencyTests-571434595 None] Created volume successfully.
Jul 23 03:32:50 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-937266d3-f804-4b97-ab49-e70a52e4d2e6" returned: 0 in 0.291s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-937266d3-f804-4b97-ab49-e70a52e4d2e6" released by "delete_volume" :: held 0.974s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Created reservations ['86b7c64d-d5d6-4e62-930c-91163855a7b8', '04139240-b19b-49aa-a2e3-e773d504b8e1', '950ee2d6-6222-4e03-8aa3-6527d56a7e49', 'd140d5e6-aee3-4ee0-a2a9-4e06b44e3352'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:50 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:50 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:51 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba" returned: 0 in 0.523s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa28f45d-62d9-4b8b-aed3-77598abd43b5_rjq829uadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Converted 0.00 MB image at 0.00 MB/s
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:51 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba 1G
Jul 23 03:32:51 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:51 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e 1073741824" returned: 0 in 0.537s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:51 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e
Jul 23 03:32:51 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:51 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Deleted volume successfully.
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-01fc1269-d474-439e-bc1e-abe02a6d99eb tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-937266d3-f804-4b97-ab49-e70a52e4d2e6-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:51 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba 1G" returned: 0 in 0.339s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Downloaded image aa28f45d-62d9-4b8b-aed3-77598abd43b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'metadata': {}}])) to volume dad2e900-d669-4cc8-b922-c9145868c1ba successfully. {{(pid=88344) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Temporary image aa28f45d-62d9-4b8b-aed3-77598abd43b5 for user 88ac3699d55844b8ba396325f861df77 is deleted. {{(pid=88344) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.volume_utils [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Marking volume dad2e900-d669-4cc8-b922-c9145868c1ba as bootable. {{(pid=88344) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Copying metadata from image aa28f45d-62d9-4b8b-aed3-77598abd43b5 to dad2e900-d669-4cc8-b922-c9145868c1ba. {{(pid=88344) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Creating volume glance metadata for volume dad2e900-d669-4cc8-b922-c9145868c1ba backed by image aa28f45d-62d9-4b8b-aed3-77598abd43b5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '73b6437f73081a37ebea523e9ff8f7d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88344) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 23 03:32:51 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c7de27-2b83-4fb7-a404-8a4410f27ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad2e900-d669-4cc8-b922-c9145868c1ba', 'volume_size': 1, 'image_id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73b6437f73081a37ebea523e9ff8f7d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d244192a8f74b00b0cc21b0dc6e5304', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a0a0b64adb50228e1e2b96f1427c790e94b33a0aa77c338d5b57334639fbdcf3f270c961831642417df641c803cefd8ad48d658a0b50250c0d0f748839d2823', 'id': 'aa28f45d-62d9-4b8b-aed3-77598abd43b5', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa28f45d-62d9-4b8b-aed3-77598abd43b5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736934f32c00>}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f65bc9-d74c-4503-ab7c-2ff6430683dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e" returned: 0 in 0.280s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.974s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1502062281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14e72d2-8674-41f0-968d-dc88eea03719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:49Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating volume f14e72d2-8674-41f0-968d-dc88eea03719 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f463080-01f3-46b3-816d-d387977ad3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacd1595-8516-42b5-b4a1-340f9af7181e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:51 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719 1073741824
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe18e15-997c-45ff-aaa9-8a58f3945817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:51 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Volume volume-dad2e900-d669-4cc8-b922-c9145868c1ba (dad2e900-d669-4cc8-b922-c9145868c1ba): created successfully
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f65bc9-d74c-4503-ab7c-2ff6430683dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Flow 'volume_create_manager' (241e649d-d045-40bb-983e-d0b34ded7b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-97a89d92-6ae0-4a02-ade6-bd03f6b0cae3 tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Created volume successfully.
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume volume-dacd1595-8516-42b5-b4a1-340f9af7181e (dacd1595-8516-42b5-b4a1-340f9af7181e): created successfully
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe18e15-997c-45ff-aaa9-8a58f3945817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (61ea65bf-b1f6-4ce4-9c64-95e6aa63c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:51 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-71256c00-3270-4575-8cb5-738411a19a67 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created volume successfully.
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Acquiring lock "cinder-4a56204c-e7ca-44c7-a236-728b80db14ea-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Lock "cinder-4a56204c-e7ca-44c7-a236-728b80db14ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:51 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719 1073741824" returned: 0 in 0.457s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Acquiring lock "cinder-quobyte-4a56204c-e7ca-44c7-a236-728b80db14ea" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Lock "cinder-quobyte-4a56204c-e7ca-44c7-a236-728b80db14ea" acquired by "delete_volume" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32c297e-931d-4b06-b0ba-db9c966e8477]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719
Jul 23 03:32:52 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:52 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea
Jul 23 03:32:52 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "cinder-quobyte-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c2783a-8cbe-4748-bac4-21f929bd929c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354
Jul 23 03:32:52 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719" returned: 0 in 0.328s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894275167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b570af73-43d1-4625-a2b8-debb979ec457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7fb835ed3564b8d94b37f7cc88b698b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:50Z,use_quota=True,user_id='b3b4bea3fee54cec98ae3318967114ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Creating volume b570af73-43d1-4625-a2b8-debb979ec457 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:52 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff57cba1-d839-45cb-94e3-76425fe43b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14e72d2-8674-41f0-968d-dc88eea03719', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:52 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457 1073741824
Jul 23 03:32:52 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da10dd3f-c078-4dd8-94e5-7eb34a13d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:52 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume volume-f14e72d2-8674-41f0-968d-dc88eea03719 (f14e72d2-8674-41f0-968d-dc88eea03719): created successfully
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da10dd3f-c078-4dd8-94e5-7eb34a13d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (b44b69a2-7161-428e-9a04-b01913660f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:52 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-dde9385f-bca5-4061-80c8-9a2c1309a4cc tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created volume successfully.
Jul 23 03:32:52 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea" returned: 0 in 0.415s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea
Jul 23 03:32:52 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354" returned: 0 in 0.461s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Acquiring lock "cinder-dad2e900-d669-4cc8-b922-c9145868c1ba-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:52 devstack sudo[106573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354
Jul 23 03:32:52 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a56204c-e7ca-44c7-a236-728b80db14ea" returned: 0 in 0.290s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "cinder-dad2e900-d669-4cc8-b922-c9145868c1ba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Lock "cinder-quobyte-4a56204c-e7ca-44c7-a236-728b80db14ea" released by "delete_volume" :: held 0.768s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Acquiring lock "cinder-quobyte-dad2e900-d669-4cc8-b922-c9145868c1ba" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "cinder-quobyte-dad2e900-d669-4cc8-b922-c9145868c1ba" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Created reservations ['c4c16d4d-8982-451a-865f-c3c446d1f578', '140d753f-7d07-4f5d-aec8-0a1917a354e6', '8def4d7c-23a0-40f8-85b6-c41366daf9c9', 'da36f4ce-dcc8-4882-ae53-f189cc27c728'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f58cc4-bde3-4cff-a434-94d16a6fedc8]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:52 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457 1073741824" returned: 0 in 0.620s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:52 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:52 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354" returned: 0 in 0.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:52 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba
Jul 23 03:32:52 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-quobyte-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354" released by "delete_volume" :: held 0.848s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:53 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457
Jul 23 03:32:53 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Created reservations ['c95ffb6f-8775-4a42-b217-0bd456edf8e5', '7ffc390b-71a5-40d3-b5e1-0b802f8e81c4', '6f08f2b3-84df-4cd8-a75d-bde7204a8cf5', '4846549c-222a-4be3-a7a5-db4847ba98d5'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:53 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:53 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:53 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.394s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:53 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Deleted volume successfully.
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e0e21dff-3829-4bc5-869f-bf647d682a09 tempest-VolumeImageDependencyTests-571434595 None] Lock "cinder-4a56204c-e7ca-44c7-a236-728b80db14ea-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:53 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba" returned: 0 in 0.566s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:53 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba
Jul 23 03:32:53 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:53 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457" returned: 0 in 0.466s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676624de-3ced-4655-af46-b09ea3f32966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b570af73-43d1-4625-a2b8-debb979ec457', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2b85eb-826b-4135-9800-dde063b6bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:53 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.337s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:53 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Deleted volume successfully.
Jul 23 03:32:53 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Volume volume-b570af73-43d1-4625-a2b8-debb979ec457 (b570af73-43d1-4625-a2b8-debb979ec457): created successfully
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2b85eb-826b-4135-9800-dde063b6bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Flow 'volume_create_manager' (09d2cf96-d24a-4366-af3f-3e79f9daad49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-72f50614-595e-453b-8b43-4f5ca29b99ac tempest-CreateVolumesFromImageTest-1145237749 None] Lock "cinder-8ca5c059-7e56-4ac2-91d3-1e5aea2ce354-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:53 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-18f67c66-73ec-4dea-a027-64aab74f5d27 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created volume successfully.
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-b570af73-43d1-4625-a2b8-debb979ec457-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:53 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dad2e900-d669-4cc8-b922-c9145868c1ba" returned: 0 in 0.373s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-b570af73-43d1-4625-a2b8-debb979ec457-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "cinder-quobyte-dad2e900-d669-4cc8-b922-c9145868c1ba" released by "delete_volume" :: held 1.001s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-b570af73-43d1-4625-a2b8-debb979ec457" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-b570af73-43d1-4625-a2b8-debb979ec457" acquired by "delete_volume" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[56280020-4a79-4433-af8a-e661c027bd9b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Created reservations ['915a8bb5-17a6-4d38-bcb9-8817164a7d50', '28c7fa9a-a1a1-4f60-b0f6-de0cf1451e68', 'f585fc6a-f297-4cda-bd47-4d07edafcee0', '98a1bc23-158e-4758-8417-65e3f67ee4a7'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:54 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:54 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:54 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457
Jul 23 03:32:54 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:54 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.315s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Deleted volume successfully.
Jul 23 03:32:54 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457" returned: 0 in 0.442s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:54 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7e7da215-34ea-4e29-80b6-ac6c8a1413fc tempest-VolumeAndVolumeTypeFromImageTest-1885266300 None] Lock "cinder-dad2e900-d669-4cc8-b922-c9145868c1ba-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:54 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:54 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b570af73-43d1-4625-a2b8-debb979ec457" returned: 0 in 0.339s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-b570af73-43d1-4625-a2b8-debb979ec457" released by "delete_volume" :: held 0.832s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['1fa535d0-1bc5-4d9d-94b6-5b343f75f0e0', 'f17a22b4-415a-4b76-873b-869925ee1fb2', '01b50098-da2f-4d50-b34d-9e5f1eebe17b', '76f614d7-b4a4-4c34-9062-589c92647419'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:54 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:54 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-f14e72d2-8674-41f0-968d-dc88eea03719-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-f14e72d2-8674-41f0-968d-dc88eea03719-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-f14e72d2-8674-41f0-968d-dc88eea03719" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-f14e72d2-8674-41f0-968d-dc88eea03719" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691d17c-eaa6-4684-9040-1097de7a6813]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:55 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719
Jul 23 03:32:55 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:55 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:55 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleted volume successfully.
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b748483e-1235-4c68-b231-67a232c4fcbd tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-b570af73-43d1-4625-a2b8-debb979ec457-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:55 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719" returned: 0 in 0.420s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:55 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719
Jul 23 03:32:55 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:55 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f14e72d2-8674-41f0-968d-dc88eea03719" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-f14e72d2-8674-41f0-968d-dc88eea03719" released by "delete_volume" :: held 0.728s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['fa79c76e-48e1-4a65-b88b-a5bfd88e0196', 'fb3cd778-2e94-4c6c-8481-a4f3f938d2b5', 'fb58fd2d-ef13-4eee-b175-d1e5d2bf9d66', 'a4a72ea6-b26d-4100-8578-bfc37939ecb2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:56 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:56 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-dacd1595-8516-42b5-b4a1-340f9af7181e-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:56 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-dacd1595-8516-42b5-b4a1-340f9af7181e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.290s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:56 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleted volume successfully.
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-bb2fc26f-c2b4-4e51-94aa-f9eb600b7ee7 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-f14e72d2-8674-41f0-968d-dc88eea03719-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-dacd1595-8516-42b5-b4a1-340f9af7181e" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-dacd1595-8516-42b5-b4a1-340f9af7181e" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[16940cb2-bf47-4906-a464-d14a415e7b90]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:56 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e
Jul 23 03:32:56 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:56 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e" returned: 0 in 0.408s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:56 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e
Jul 23 03:32:56 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:57 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-dacd1595-8516-42b5-b4a1-340f9af7181e" returned: 0 in 0.373s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-dacd1595-8516-42b5-b4a1-340f9af7181e" released by "delete_volume" :: held 0.826s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['f181456b-c4c6-4166-98e3-3457dbba879b', 'dc0790e1-8976-419e-b8ad-dc69a74dd6dd', '559da3d8-8142-4477-893b-7e03da719ece', 'c44c1eb2-835b-4c5e-b227-19ecf4dc7544'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:57 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:57 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-d96b8b80-2025-45a1-a12a-7943c9ba3460-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-d96b8b80-2025-45a1-a12a-7943c9ba3460-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-d96b8b80-2025-45a1-a12a-7943c9ba3460" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-d96b8b80-2025-45a1-a12a-7943c9ba3460" acquired by "delete_volume" :: waited 0.040s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa995310-cf43-4279-8d06-8feed7df5141]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:57 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460
Jul 23 03:32:57 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:57 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.490s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleted volume successfully.
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7d241193-b9cd-4db8-b07b-8d3e301535c5 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-dacd1595-8516-42b5-b4a1-340f9af7181e-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:57 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Flow 'volume_create_manager' (197d409b-4b7d-41a4-b1d5-8e060f040e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed265ad5-0d6d-40fc-bacc-d463e3d6b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed265ad5-0d6d-40fc-bacc-d463e3d6b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbc732f-24b2-4d27-8e92-9b691f824a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753f05ba7b8c410489149c50635e9e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:58Z,use_quota=True,user_id='688666b31dd3401486e90a799ee253df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa8de91-2f81-4805-921d-baa379cb7ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa8de91-2f81-4805-921d-baa379cb7ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d08e2d-b2a2-488e-9ace-308de9af13dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d08e2d-b2a2-488e-9ace-308de9af13dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbc732f-24b2-4d27-8e92-9b691f824a54', 'volume_name': 'volume-1cbc732f-24b2-4d27-8e92-9b691f824a54', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc273d7d-3254-4c49-af27-689f4e4333d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc273d7d-3254-4c49-af27-689f4e4333d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7548e077-5992-46f7-bc92-5e10aa3dfcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Volume 1cbc732f-24b2-4d27-8e92-9b691f824a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbc732f-24b2-4d27-8e92-9b691f824a54', 'volume_size': 1}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbc732f-24b2-4d27-8e92-9b691f824a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753f05ba7b8c410489149c50635e9e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:58Z,use_quota=True,user_id='688666b31dd3401486e90a799ee253df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Creating volume 1cbc732f-24b2-4d27-8e92-9b691f824a54 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:32:58 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:58 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 1073741824
Jul 23 03:32:58 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:58 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460" returned: 0 in 0.497s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:58 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460
Jul 23 03:32:58 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-79d22f14-5004-42c5-8c48-5d0868fba2dc tempest-ProjectAdminTests-1095879913 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88344) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 23 03:32:58 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d96b8b80-2025-45a1-a12a-7943c9ba3460" returned: 0 in 0.353s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-d96b8b80-2025-45a1-a12a-7943c9ba3460" released by "delete_volume" :: held 0.911s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['49b36499-efcb-4bcc-a0e6-7265c753b476', '8379b907-29c5-47c9-b889-5dff3a5da10c', 'c31bd13d-e30d-4a9f-97db-4cdd4052766f', 'a0cc6b1e-eb34-440a-9701-60fff523f567'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:58 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 1073741824" returned: 0 in 0.574s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:58 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:58 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:58 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54
Jul 23 03:32:58 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:58 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:32:58 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5cac5c-b301-4379-8187-2de2a3254758]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:59 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54" returned: 0 in 0.389s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:59 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc
Jul 23 03:32:59 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7548e077-5992-46f7-bc92-5e10aa3dfcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbc732f-24b2-4d27-8e92-9b691f824a54', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067c3398-d3b5-4d7c-8d09-4aec875775f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:32:59 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Volume volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 (1cbc732f-24b2-4d27-8e92-9b691f824a54): created successfully
Jul 23 03:32:59 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067c3398-d3b5-4d7c-8d09-4aec875775f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Flow 'volume_create_manager' (197d409b-4b7d-41a4-b1d5-8e060f040e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.428s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:32:59 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-032a9740-0946-4805-a562-ec2a672d0d46 tempest-CinderUnicodeTest-382157983 None] Created volume successfully.
Jul 23 03:32:59 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.608s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:32:59 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleted volume successfully.
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1c18d803-9a28-439b-8852-c73bb11f1612 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-d96b8b80-2025-45a1-a12a-7943c9ba3460-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:59 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:32:59 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc
Jul 23 03:32:59 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:32:59 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc" released by "delete_volume" :: held 0.798s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['90fcab6c-d5f8-4a71-8b78-2fdbaa1b9bf9', 'fe330cc1-b1f2-4219-8f03-0c5524b4b0db', '0a95d45a-8139-4d05-acd8-96d770e37641', '33d821f7-84f1-4617-8906-56a18340b68a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:32:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:00 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:00 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-6e67b04b-1aac-4a2b-891b-eb91358454ee-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-6e67b04b-1aac-4a2b-891b-eb91358454ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-44c9c094-002d-4654-b588-a5ddba9159ea" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-44c9c094-002d-4654-b588-a5ddba9159ea" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-6e67b04b-1aac-4a2b-891b-eb91358454ee" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-6e67b04b-1aac-4a2b-891b-eb91358454ee" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleting offline snapshot 6e67b04b-1aac-4a2b-891b-eb91358454ee of volume 44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] snapshot_file for this snap is: volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dbf0ac-7b69-4ec4-9f62-57ff274ef4a0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:00 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleted volume successfully.
Jul 23 03:33:00 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee
Jul 23 03:33:00 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-f16cfd7e-e952-4a5f-91c2-8e090388173a tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-b5cee93a-b98a-4d2e-9506-cf4fdcb89ddc-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:00 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee" returned: 0 in 0.524s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44c9c094-002d-4654-b588-a5ddba9159ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5ce341-4af4-4557-8b36-539841ded5c9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Flow 'volume_create_manager' (94e9e90b-c866-487c-95fa-880c2c6e10be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1983192-09e7-4511-bdef-18153774a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1983192-09e7-4511-bdef-18153774a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-212620723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83176a15-a4e2-4273-83fd-12e110c60204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753f05ba7b8c410489149c50635e9e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:01Z,use_quota=True,user_id='688666b31dd3401486e90a799ee253df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beef6ebb-d99d-4326-8be2-e4911f312037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beef6ebb-d99d-4326-8be2-e4911f312037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8895a02f-470f-41c8-b2ee-f8e27d2a1eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8895a02f-470f-41c8-b2ee-f8e27d2a1eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83176a15-a4e2-4273-83fd-12e110c60204', 'volume_name': 'volume-83176a15-a4e2-4273-83fd-12e110c60204', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81530077-f505-4227-a192-7c81263c2c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81530077-f505-4227-a192-7c81263c2c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b196d089-319f-47fb-b5fe-fb253cf3e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:00 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Volume 83176a15-a4e2-4273-83fd-12e110c60204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83176a15-a4e2-4273-83fd-12e110c60204', 'volume_size': 1}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-212620723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83176a15-a4e2-4273-83fd-12e110c60204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753f05ba7b8c410489149c50635e9e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:01Z,use_quota=True,user_id='688666b31dd3401486e90a799ee253df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Creating volume 83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:00 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:00 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 1073741824
Jul 23 03:33:00 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea
Jul 23 03:33:00 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:00 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (4e5adf23-41cb-473c-b844-5ae74266ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c3224f-bee0-4997-a524-c5469d74d83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:01 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea" returned: 0 in 0.532s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c3224f-bee0-4997-a524-c5469d74d83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421969651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f90dce-8aca-4030-825d-dcd4f8c2e2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:01Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:01 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee
Jul 23 03:33:01 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cae475-3915-4a8f-8da8-91898b7b7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cae475-3915-4a8f-8da8-91898b7b7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa7170e-b5eb-4e43-b01a-869fc5be3adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa7170e-b5eb-4e43-b01a-869fc5be3adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f90dce-8aca-4030-825d-dcd4f8c2e2e3', 'volume_name': 'volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af83202-937f-4456-8116-c453c9cdb0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af83202-937f-4456-8116-c453c9cdb0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa67ebd-0743-44e9-adb2-9bb14034d9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume d8f90dce-8aca-4030-825d-dcd4f8c2e2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3', 'volume_size': 1}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:01 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 1073741824" returned: 0 in 0.596s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:01 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204
Jul 23 03:33:01 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:01 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee" returned: 0 in 0.394s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:01 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee
Jul 23 03:33:01 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:01 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204" returned: 0 in 0.292s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421969651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f90dce-8aca-4030-825d-dcd4f8c2e2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:01Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Creating volume d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:01 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b196d089-319f-47fb-b5fe-fb253cf3e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83176a15-a4e2-4273-83fd-12e110c60204', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2107a7c7-4015-47be-82fc-67e12f1894c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:01 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 1073741824
Jul 23 03:33:01 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Volume volume-83176a15-a4e2-4273-83fd-12e110c60204 (83176a15-a4e2-4273-83fd-12e110c60204): created successfully
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2107a7c7-4015-47be-82fc-67e12f1894c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Flow 'volume_create_manager' (94e9e90b-c866-487c-95fa-880c2c6e10be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-18bd08bf-8705-476a-a7bb-6e66685e3e86 tempest-CinderUnicodeTest-382157983 None] Created volume successfully.
Jul 23 03:33:02 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea.6e67b04b-1aac-4a2b-891b-eb91358454ee" returned: 0 in 0.303s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-6e67b04b-1aac-4a2b-891b-eb91358454ee" released by "_delete_snapshot" :: held 1.914s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-44c9c094-002d-4654-b588-a5ddba9159ea" released by "delete_snapshot" :: held 1.948s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['85db3317-90ae-4c96-af4f-179e44188200', '27feeadb-4f74-469a-8b17-d6970fca38d6', '76e00f48-9639-47f4-a46a-d14c7f2e7474', 'c8883d5b-9830-44f0-9db2-567acfc5ce7d'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Delete snapshot completed successfully.
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-21ab7903-e063-4af3-a1bd-8e68501a4f78 tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-6e67b04b-1aac-4a2b-891b-eb91358454ee-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:02 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 1073741824" returned: 0 in 0.529s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:02 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3
Jul 23 03:33:02 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:02 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3" returned: 0 in 0.232s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa67ebd-0743-44e9-adb2-9bb14034d9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236483cb-6c6d-4bd9-b9e4-8d637cf19df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:02 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 (d8f90dce-8aca-4030-825d-dcd4f8c2e2e3): created successfully
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236483cb-6c6d-4bd9-b9e4-8d637cf19df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:02 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (4e5adf23-41cb-473c-b844-5ae74266ac18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-888f6b06-3da4-4cfd-9453-8689d9be3b5c tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created volume successfully.
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Creating offline snapshot 2c03d949-f901-439e-bd36-bdc194cf2c7f of volume 83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b1a12-9433-4953-a90a-52087d93df80]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:03 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204
Jul 23 03:33:03 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-44c9c094-002d-4654-b588-a5ddba9159ea-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-44c9c094-002d-4654-b588-a5ddba9159ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "cinder-quobyte-44c9c094-002d-4654-b588-a5ddba9159ea" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-44c9c094-002d-4654-b588-a5ddba9159ea" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0c6fd-b262-4169-acbb-37fb1d9a702d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:03 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204" returned: 0 in 0.449s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:03 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f 1G
Jul 23 03:33:03 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:03 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea
Jul 23 03:33:03 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:03 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea" returned: 0 in 0.474s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:04 devstack sudo[106722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea
Jul 23 03:33:04 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (57516baf-86ba-4219-99d2-a0f24bad1b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b0e58a-2107-4ad1-9482-4d8ad02222c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b0e58a-2107-4ad1-9482-4d8ad02222c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-290591857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e66e2-ccc7-4b33-8040-981712107443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:04Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cca920-bf16-437a-91a9-d22ba956dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cca920-bf16-437a-91a9-d22ba956dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84b3206-b597-439e-b79c-960d824a1e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84b3206-b597-439e-b79c-960d824a1e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7e66e2-ccc7-4b33-8040-981712107443', 'volume_name': 'volume-fc7e66e2-ccc7-4b33-8040-981712107443', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681e2507-50c5-4663-9b56-b25579b2d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681e2507-50c5-4663-9b56-b25579b2d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e501ef42-bfd3-4681-886b-a38406c99314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume fc7e66e2-ccc7-4b33-8040-981712107443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7e66e2-ccc7-4b33-8040-981712107443', 'volume_size': 1}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:04 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f 1G" returned: 0 in 0.626s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83176a15-a4e2-4273-83fd-12e110c60204 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:04 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83176a15-a4e2-4273-83fd-12e110c60204 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f
Jul 23 03:33:04 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:04 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-44c9c094-002d-4654-b588-a5ddba9159ea" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-quobyte-44c9c094-002d-4654-b588-a5ddba9159ea" released by "delete_volume" :: held 0.925s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (fa70e7c8-fa47-4fec-a893-63f4f5cbb8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc51a1f-940c-48a6-a5f7-73b9a6b4a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Created reservations ['14052e74-7b06-408d-8012-fa0a009ea653', 'a81d7824-0c90-4638-9c1b-bbc5b2134bc3', 'f6cfe22b-1492-49c1-ae65-c8a8768541a1', 'd317996d-4f92-455d-a60f-ab9fd4677b58'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc51a1f-940c-48a6-a5f7-73b9a6b4a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22907667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8648852-0f8f-4f2d-8048-6e541a4c6c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:04Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930cf877-cf3f-4268-a340-db9e3934b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930cf877-cf3f-4268-a340-db9e3934b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1243744-afcf-4c8b-95e1-d212da73c05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1243744-afcf-4c8b-95e1-d212da73c05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8648852-0f8f-4f2d-8048-6e541a4c6c3e', 'volume_name': 'volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b76457-cb0d-4983-bfb9-9a7c6e82f72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b76457-cb0d-4983-bfb9-9a7c6e82f72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453deb61-c2af-4a26-80b5-9526111c5f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:04 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume f8648852-0f8f-4f2d-8048-6e541a4c6c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e', 'volume_size': 1}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:04 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83176a15-a4e2-4273-83fd-12e110c60204 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f" returned: 0 in 0.479s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:04 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f is being set with open permissions: ugo+rw
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:04 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f
Jul 23 03:33:04 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:04 devstack sudo[106733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:04 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:05 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f" returned: 0 in 0.377s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (fc4c3728-1e45-48b7-ab0e-f582be6e6c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3580590e-5be7-476e-bc33-3d952607e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3580590e-5be7-476e-bc33-3d952607e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875775023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:05Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35179954-f735-4c8d-9262-4d8577d5f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35179954-f735-4c8d-9262-4d8577d5f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f8a813-dce2-4cfa-86d8-dddd433ff7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f8a813-dce2-4cfa-86d8-dddd433ff7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8', 'volume_name': 'volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86155516-fe0c-4041-afe6-d2429536bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86155516-fe0c-4041-afe6-d2429536bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622f3e12-b99f-4c26-a172-a3d93a012a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume 537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8', 'volume_size': 1}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:05 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.558s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Deleted volume successfully.
Jul 23 03:33:05 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info
Jul 23 03:33:05 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fade5cdb-dc9d-4446-b2ca-84212cf7350f tempest-CreateVolumesFromSnapshotTest-1574350187 None] Lock "cinder-44c9c094-002d-4654-b588-a5ddba9159ea-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:05 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (00184115-3b25-42df-b702-892b16bb64b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df00d7-0ebe-43cb-bd1a-8a0732cd9364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info" returned: 0 in 0.416s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:05 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info is being set with open permissions: ugo+rw
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:05 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df00d7-0ebe-43cb-bd1a-8a0732cd9364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971568583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571940bd-c03b-405a-96e7-8283e0caefc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:06Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41958afc-23e5-4ced-b78a-b5bfa9d591a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41958afc-23e5-4ced-b78a-b5bfa9d591a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb16ba68-d6b4-464c-ba3a-c56577f76001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb16ba68-d6b4-464c-ba3a-c56577f76001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571940bd-c03b-405a-96e7-8283e0caefc6', 'volume_name': 'volume-571940bd-c03b-405a-96e7-8283e0caefc6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ad6cf8-7773-43f9-9f8c-cb8763b0c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ad6cf8-7773-43f9-9f8c-cb8763b0c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c547b7d-b0b5-4ecf-beea-b0245ee0f409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:05 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume 571940bd-c03b-405a-96e7-8283e0caefc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571940bd-c03b-405a-96e7-8283e0caefc6', 'volume_size': 1}
Jul 23 03:33:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:06 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.info" returned: 0 in 0.515s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-290591857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7e66e2-ccc7-4b33-8040-981712107443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:04Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Creating volume fc7e66e2-ccc7-4b33-8040-981712107443 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:06 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:06 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443 1073741824
Jul 23 03:33:06 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (ef799185-ade2-4344-a65f-fe5d46b8f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79c8f7b-0d6a-49ba-b672-1c67eaedf5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79c8f7b-0d6a-49ba-b672-1c67eaedf5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771838156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5454ecad-2edc-415e-bb66-8733001c5355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:06Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5104cb39-b61e-444c-9044-a0e93d7cc511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5104cb39-b61e-444c-9044-a0e93d7cc511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8dcf68-888e-4567-b247-a84f6a5b9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8dcf68-888e-4567-b247-a84f6a5b9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5454ecad-2edc-415e-bb66-8733001c5355', 'volume_name': 'volume-5454ecad-2edc-415e-bb66-8733001c5355', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e2ac20-a81c-4fcd-9d83-101c97e2d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e2ac20-a81c-4fcd-9d83-101c97e2d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401e480-4064-4272-b64c-d2c9f5f0e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:06 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume 5454ecad-2edc-415e-bb66-8733001c5355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5454ecad-2edc-415e-bb66-8733001c5355', 'volume_size': 1}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:06 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-34e0620d-66fa-424a-a164-216042a4cfb4 tempest-CinderUnicodeTest-382157983 None] Create snapshot completed successfully
Jul 23 03:33:06 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443 1073741824" returned: 0 in 0.592s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:06 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443
Jul 23 03:33:06 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:07 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.596s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22907667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8648852-0f8f-4f2d-8048-6e541a4c6c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:04Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Creating volume f8648852-0f8f-4f2d-8048-6e541a4c6c3e {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:07 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:07 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e 1073741824
Jul 23 03:33:07 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e501ef42-bfd3-4681-886b-a38406c99314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7e66e2-ccc7-4b33-8040-981712107443', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba44252-a30c-4d02-9630-c5c9bc2199d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:07 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume volume-fc7e66e2-ccc7-4b33-8040-981712107443 (fc7e66e2-ccc7-4b33-8040-981712107443): created successfully
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba44252-a30c-4d02-9630-c5c9bc2199d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (57516baf-86ba-4219-99d2-a0f24bad1b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-bf6f36d1-e83a-47b4-8568-dd96d0e066f8 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created volume successfully.
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-2c03d949-f901-439e-bd36-bdc194cf2c7f-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-2c03d949-f901-439e-bd36-bdc194cf2c7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-quobyte-83176a15-a4e2-4273-83fd-12e110c60204" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-83176a15-a4e2-4273-83fd-12e110c60204" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-quobyte-2c03d949-f901-439e-bd36-bdc194cf2c7f" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-2c03d949-f901-439e-bd36-bdc194cf2c7f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Deleting offline snapshot 2c03d949-f901-439e-bd36-bdc194cf2c7f of volume 83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] snapshot_file for this snap is: volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b2b11-0b30-41e3-a1d0-8c4cb8d5cbf8]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:07 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f
Jul 23 03:33:07 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:07 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e 1073741824" returned: 0 in 0.546s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:07 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e
Jul 23 03:33:07 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:07 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f" returned: 0 in 0.425s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:07 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83176a15-a4e2-4273-83fd-12e110c60204(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f3d97e-9d0f-4a61-8d97-6b480ccef10f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:08 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e" returned: 0 in 0.319s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875775023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:05Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Creating volume 537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:08 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:08 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204
Jul 23 03:33:08 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:08 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 1073741824
Jul 23 03:33:08 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453deb61-c2af-4a26-80b5-9526111c5f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547c7935-6a36-4cde-9d96-392e22932f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:08 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e (f8648852-0f8f-4f2d-8048-6e541a4c6c3e): created successfully
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547c7935-6a36-4cde-9d96-392e22932f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (fa70e7c8-fa47-4fec-a893-63f4f5cbb8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:08 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-771a00f6-4a1d-4d27-beb9-494286584350 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created volume successfully.
Jul 23 03:33:08 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204" returned: 0 in 0.467s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:08 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f
Jul 23 03:33:08 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:08 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 1073741824" returned: 0 in 0.617s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:08 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8
Jul 23 03:33:08 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:08 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f" returned: 0 in 0.442s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:08 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f
Jul 23 03:33:08 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:09 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8" returned: 0 in 0.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.347s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971568583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571940bd-c03b-405a-96e7-8283e0caefc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:06Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Creating volume 571940bd-c03b-405a-96e7-8283e0caefc6 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:09 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622f3e12-b99f-4c26-a172-a3d93a012a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:09 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6 1073741824
Jul 23 03:33:09 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984a618b-051d-4536-9e9c-31ed195bbcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:09 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 (537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8): created successfully
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984a618b-051d-4536-9e9c-31ed195bbcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (fc4c3728-1e45-48b7-ab0e-f582be6e6c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:09 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b1184d3d-ee05-4eb7-bc12-c5ec2e90ac27 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created volume successfully.
Jul 23 03:33:09 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204.2c03d949-f901-439e-bd36-bdc194cf2c7f" returned: 0 in 0.329s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-2c03d949-f901-439e-bd36-bdc194cf2c7f" released by "_delete_snapshot" :: held 1.796s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-83176a15-a4e2-4273-83fd-12e110c60204" released by "delete_snapshot" :: held 1.825s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Created reservations ['03673708-44d1-49e4-befd-7e19f700e05a', 'dd684163-685e-49df-a4a0-a9192ae52779', '3a5c77c4-ec92-4280-8632-f569f624c48e', '6a78ea65-b129-4b98-aa92-baa4398c45dd'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:09 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Delete snapshot completed successfully.
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e959bc8b-9cf8-4b81-bda0-90cc0db2a284 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-2c03d949-f901-439e-bd36-bdc194cf2c7f-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Flow 'volume_create_manager' (c2fc5cae-3303-41b3-8680-5f107113f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5a29c7-8f6c-4b73-8a54-28752dca073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5a29c7-8f6c-4b73-8a54-28752dca073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1741117840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1a9668-887e-466d-8bc6-951e489b087d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325ad6f8228f459685014c1ad5dcfcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:09Z,use_quota=True,user_id='8ae09afdc7dc485286b5e7f2ae914bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ea4f63-cd5b-445a-a36e-5f6524fb40f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ea4f63-cd5b-445a-a36e-5f6524fb40f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a69bb66-020d-49ed-abc5-c8328c85a380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a69bb66-020d-49ed-abc5-c8328c85a380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1a9668-887e-466d-8bc6-951e489b087d', 'volume_name': 'volume-0d1a9668-887e-466d-8bc6-951e489b087d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c74d88-ffef-4cda-8fa8-75c71b5bac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c74d88-ffef-4cda-8fa8-75c71b5bac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e171ea48-4cf6-4fac-8750-51121ecc6371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:09 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Volume 0d1a9668-887e-466d-8bc6-951e489b087d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1a9668-887e-466d-8bc6-951e489b087d', 'volume_size': 1}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:09 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6 1073741824" returned: 0 in 0.494s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:09 devstack sudo[106801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6
Jul 23 03:33:09 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-83176a15-a4e2-4273-83fd-12e110c60204-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-83176a15-a4e2-4273-83fd-12e110c60204-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-quobyte-83176a15-a4e2-4273-83fd-12e110c60204" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-83176a15-a4e2-4273-83fd-12e110c60204" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[053d7a62-4442-4566-bab0-4500012a7750]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:09 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204
Jul 23 03:33:09 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:09 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6" returned: 0 in 0.281s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771838156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5454ecad-2edc-415e-bb66-8733001c5355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8573a12c734cc8b09fec3356b31d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:06Z,use_quota=True,user_id='24644c7a9f5d412691bfd6d02ec59b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Creating volume 5454ecad-2edc-415e-bb66-8733001c5355 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:09 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c547b7d-b0b5-4ecf-beea-b0245ee0f409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571940bd-c03b-405a-96e7-8283e0caefc6', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864a75b6-5321-466d-9165-ee8478947758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:10 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355 1073741824
Jul 23 03:33:10 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:10 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume volume-571940bd-c03b-405a-96e7-8283e0caefc6 (571940bd-c03b-405a-96e7-8283e0caefc6): created successfully
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864a75b6-5321-466d-9165-ee8478947758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (00184115-3b25-42df-b702-892b16bb64b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-683ac175-56e4-4941-b682-1f3ad745db70 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created volume successfully.
Jul 23 03:33:10 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:10 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204
Jul 23 03:33:10 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:10 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355 1073741824" returned: 0 in 0.454s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:10 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-83176a15-a4e2-4273-83fd-12e110c60204" returned: 0 in 0.269s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:10 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355
Jul 23 03:33:10 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-83176a15-a4e2-4273-83fd-12e110c60204" released by "delete_volume" :: held 0.708s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Created reservations ['661141b4-13d6-4fec-8b29-3fdcb1e1d32c', 'fb3d3f4c-369d-46a9-a3c1-a6e12a25f13c', '806045b8-966e-490f-b60e-749a34d38393', '38649c26-c22c-40e1-901a-50c44f0e14fb'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:10 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:10 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:10 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355" returned: 0 in 0.307s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1741117840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1a9668-887e-466d-8bc6-951e489b087d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325ad6f8228f459685014c1ad5dcfcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:09Z,use_quota=True,user_id='8ae09afdc7dc485286b5e7f2ae914bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Creating volume 0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:10 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401e480-4064-4272-b64c-d2c9f5f0e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5454ecad-2edc-415e-bb66-8733001c5355', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c038990-f7e7-4c7f-9c07-68053c30fa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:10 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d 1073741824
Jul 23 03:33:10 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:10 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Volume volume-5454ecad-2edc-415e-bb66-8733001c5355 (5454ecad-2edc-415e-bb66-8733001c5355): created successfully
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c038990-f7e7-4c7f-9c07-68053c30fa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Flow 'volume_create_manager' (ef799185-ade2-4344-a65f-fe5d46b8f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-949f00d8-d3d5-41d4-b795-25f92ad97235 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created volume successfully.
Jul 23 03:33:10 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.300s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:10 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:10 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Deleted volume successfully.
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-1cbc732f-24b2-4d27-8e92-9b691f824a54-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b030f5ab-9c8e-4f90-8829-efb7271842c7 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-83176a15-a4e2-4273-83fd-12e110c60204-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-1cbc732f-24b2-4d27-8e92-9b691f824a54-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "cinder-quobyte-1cbc732f-24b2-4d27-8e92-9b691f824a54" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-1cbc732f-24b2-4d27-8e92-9b691f824a54" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f1e7f-5e75-4e3b-a379-7d4f9d29398e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:11 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54
Jul 23 03:33:11 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:11 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d 1073741824" returned: 0 in 0.607s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:11 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:11 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:11 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54" returned: 0 in 0.461s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:11 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54
Jul 23 03:33:11 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:11 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.283s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e171ea48-4cf6-4fac-8750-51121ecc6371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1a9668-887e-466d-8bc6-951e489b087d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcebff0-7fad-40a7-844e-9a12226835df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:11 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Volume volume-0d1a9668-887e-466d-8bc6-951e489b087d (0d1a9668-887e-466d-8bc6-951e489b087d): created successfully
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcebff0-7fad-40a7-844e-9a12226835df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Flow 'volume_create_manager' (c2fc5cae-3303-41b3-8680-5f107113f005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-17c00bfc-df8b-45a7-a505-cd142b1b1e06 tempest-VolumeDependencyTests-410655859 None] Created volume successfully.
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-5454ecad-2edc-415e-bb66-8733001c5355-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:11 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-5454ecad-2edc-415e-bb66-8733001c5355-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-1cbc732f-24b2-4d27-8e92-9b691f824a54" returned: 0 in 0.275s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-quobyte-1cbc732f-24b2-4d27-8e92-9b691f824a54" released by "delete_volume" :: held 0.783s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-quobyte-5454ecad-2edc-415e-bb66-8733001c5355" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-5454ecad-2edc-415e-bb66-8733001c5355" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee2dec-cffb-4caf-b8a8-9ee45b6c1500]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:11 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Created reservations ['3ae501ad-0b8a-4b3a-aff0-7f76cfd39fb5', '71c74d40-036a-42a0-9544-7d300a5b071a', '2eb0c052-c60b-43fb-a20c-e72529c28682', '4f5568f1-b062-4a9f-861c-e63e0129ec17'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:12 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:12 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:12 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355
Jul 23 03:33:12 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:12 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.273s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Deleted volume successfully.
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-13522a47-30b7-4a74-aa90-d57230353411 tempest-CinderUnicodeTest-382157983 None] Lock "cinder-1cbc732f-24b2-4d27-8e92-9b691f824a54-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:12 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355" returned: 0 in 0.406s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:12 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355
Jul 23 03:33:12 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Creating offline snapshot d7557136-0fe3-4fc1-bb3b-a0630860c2eb of volume 0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c92aeb-ed37-4d64-b518-304fc708b214]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:12 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5454ecad-2edc-415e-bb66-8733001c5355" returned: 0 in 0.321s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-5454ecad-2edc-415e-bb66-8733001c5355" released by "delete_volume" :: held 0.778s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created reservations ['b968022f-db5e-4a7b-b25a-00c2d545a92d', 'bbd443fe-f140-4f2b-877d-1cdc3316ae7a', 'f0d3a923-5841-4a72-9a7c-8eec52faa966', '78cfb0ba-8024-4cf3-a755-3f75f246473c'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:12 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:12 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:12 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:12 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-571940bd-c03b-405a-96e7-8283e0caefc6-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-571940bd-c03b-405a-96e7-8283e0caefc6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-quobyte-571940bd-c03b-405a-96e7-8283e0caefc6" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-571940bd-c03b-405a-96e7-8283e0caefc6" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:13 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.574s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20f51d-593f-45e3-9189-cb92cfe8514e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:13 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb 1G
Jul 23 03:33:13 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:13 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.481s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:13 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6
Jul 23 03:33:13 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:13 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Deleted volume successfully.
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-83626cef-ff2a-42bc-97bf-1a8f2a4d5086 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-5454ecad-2edc-415e-bb66-8733001c5355-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:13 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:13 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6
Jul 23 03:33:13 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:13 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb 1G" returned: 0 in 0.551s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d1a9668-887e-466d-8bc6-951e489b087d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:13 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d1a9668-887e-466d-8bc6-951e489b087d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb
Jul 23 03:33:13 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:14 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-571940bd-c03b-405a-96e7-8283e0caefc6" returned: 0 in 0.377s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-571940bd-c03b-405a-96e7-8283e0caefc6" released by "delete_volume" :: held 0.904s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:14 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d1a9668-887e-466d-8bc6-951e489b087d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb" returned: 0 in 0.402s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:14 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb is being set with open permissions: ugo+rw
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created reservations ['78953bd8-0b73-4b08-a963-75c48bb89fb4', '4b1424dd-86d1-45b9-b6de-2164b7f4da1e', '463ea643-4e46-4a07-898b-465b03b430dd', 'f0b0373b-4b2a-42c8-aae7-b19a67737f7c'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:14 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb
Jul 23 03:33:14 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:14 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:14 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:14 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb" returned: 0 in 0.355s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:14 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info
Jul 23 03:33:14 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:14 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Deleted volume successfully.
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-742d03b9-eaf0-4cfb-a588-097423edd50b tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-571940bd-c03b-405a-96e7-8283e0caefc6-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:14 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info" returned: 0 in 0.312s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:14 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info is being set with open permissions: ugo+rw
Jul 23 03:33:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:14 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info
Jul 23 03:33:14 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:15 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.info" returned: 0 in 0.304s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6ed781d6-f4f2-462d-967a-378d0c6acb2c tempest-VolumeDependencyTests-410655859 None] Create snapshot completed successfully
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-quobyte-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55785b2-9d4a-4e1b-a4bb-b87c0c95bcf1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:15 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8
Jul 23 03:33:15 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:15 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8" returned: 0 in 0.433s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:15 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8
Jul 23 03:33:15 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:16 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8" returned: 0 in 0.301s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8" released by "delete_volume" :: held 0.792s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created reservations ['8e966c0d-badd-43a4-90a2-046bd531a238', 'b853c825-36c7-4391-8c80-1df68bb73585', 'ffebbf75-8785-49af-b08d-57e7c13d33e5', 'bcf4716c-9e9b-44db-9b2d-19e3e1d7f92e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:16 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:16 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Flow 'volume_create_manager' (b7a79414-32fd-46e9-9e67-292973d3e0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37706cb-586a-489c-8149-e25b82baf0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37706cb-586a-489c-8149-e25b82baf0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1851012718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd45e25d-4a19-4256-a142-38b40b5c929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325ad6f8228f459685014c1ad5dcfcc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7557136-0fe3-4fc1-bb3b-a0630860c2eb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:16Z,use_quota=True,user_id='8ae09afdc7dc485286b5e7f2ae914bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d83498-5116-4250-a38b-2ce6ddb74d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d83498-5116-4250-a38b-2ce6ddb74d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349faab7-8719-4d77-a8de-460f7f14b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349faab7-8719-4d77-a8de-460f7f14b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd45e25d-4a19-4256-a142-38b40b5c929d', 'volume_name': 'volume-cd45e25d-4a19-4256-a142-38b40b5c929d', 'volume_size': 1, 'snapshot_id': 'd7557136-0fe3-4fc1-bb3b-a0630860c2eb'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09907c0-4d31-4c5f-b259-72b5dfe7f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09907c0-4d31-4c5f-b259-72b5dfe7f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf63cfe4-5c2d-41ce-b844-3a033c40741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:16 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Volume cd45e25d-4a19-4256-a142-38b40b5c929d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd45e25d-4a19-4256-a142-38b40b5c929d', 'volume_size': 1, 'snapshot_id': 'd7557136-0fe3-4fc1-bb3b-a0630860c2eb'}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-f8648852-0f8f-4f2d-8048-6e541a4c6c3e-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-quobyte-d7557136-0fe3-4fc1-bb3b-a0630860c2eb-cd45e25d-4a19-4256-a142-38b40b5c929d" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-f8648852-0f8f-4f2d-8048-6e541a4c6c3e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-d7557136-0fe3-4fc1-bb3b-a0630860c2eb-cd45e25d-4a19-4256-a142-38b40b5c929d" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Creating volume cd45e25d-4a19-4256-a142-38b40b5c929d from snapshot d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-quobyte-cd45e25d-4a19-4256-a142-38b40b5c929d" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-cd45e25d-4a19-4256-a142-38b40b5c929d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] snapshot: d7557136-0fe3-4fc1-bb3b-a0630860c2eb, volume: cd45e25d-4a19-4256-a142-38b40b5c929d,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-quobyte-f8648852-0f8f-4f2d-8048-6e541a4c6c3e" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:16 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.353s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-f8648852-0f8f-4f2d-8048-6e541a4c6c3e" acquired by "delete_volume" :: waited 0.052s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Deleted volume successfully.
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[32750dd4-9056-40e4-9a43-91349202c55e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f5b99-fc45-4d9b-91a9-d4566e6cbae3]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-2e648041-95e7-4df1-8021-31ad06294369 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-537cadaf-10f1-4c1f-aa9d-7c6354ffc1c8-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:16 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb
Jul 23 03:33:16 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:16 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e
Jul 23 03:33:16 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:17 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e" returned: 0 in 0.416s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:17 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:17 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb" returned: 0 in 0.469s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:17 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d1a9668-887e-466d-8bc6-951e489b087d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd245d04-b91c-425f-a329-4dff3dc0d69c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:17 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:17 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:17 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-f8648852-0f8f-4f2d-8048-6e541a4c6c3e" returned: 0 in 0.338s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-f8648852-0f8f-4f2d-8048-6e541a4c6c3e" released by "delete_volume" :: held 0.806s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created reservations ['71842d1b-01b0-4b3c-b068-2d7e8d1551d3', 'cd0b5f84-e97d-4322-b576-827b9a51eabf', '62c539f4-e7c4-4cb2-a271-9faddb0fa951', 'ce47e66a-2083-4a8a-a56d-0e9d6186f80e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:17 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.482s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:17 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:17 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:17 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d
Jul 23 03:33:17 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-fc7e66e2-ccc7-4b33-8040-981712107443-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-fc7e66e2-ccc7-4b33-8040-981712107443-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-quobyte-fc7e66e2-ccc7-4b33-8040-981712107443" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-fc7e66e2-ccc7-4b33-8040-981712107443" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89f624c-cd0b-463a-a833-96fc0b4ef2e9]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:18 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.398s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:18 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Deleted volume successfully.
Jul 23 03:33:18 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443
Jul 23 03:33:18 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-84538387-e00e-4fab-a533-e19054aa3a94 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-f8648852-0f8f-4f2d-8048-6e541a4c6c3e-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:18 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443" returned: 0 in 0.714s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:18 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443
Jul 23 03:33:18 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:19 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-fc7e66e2-ccc7-4b33-8040-981712107443" returned: 0 in 0.456s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-fc7e66e2-ccc7-4b33-8040-981712107443" released by "delete_volume" :: held 1.251s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created reservations ['27818184-807a-4e1f-8602-78deb8791f63', 'c6935a4f-1800-4965-a138-354b4a01764b', '7b1ea79a-4379-4556-a66b-1538e8a16a18', '9cd02f1f-2783-4fd0-ba30-8f9268a5b85e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:19 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:19 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:20 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.470s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Deleted volume successfully.
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-152171d7-ccaa-4e41-89a1-30f9a7fd4bd3 tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-fc7e66e2-ccc7-4b33-8040-981712107443-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "cinder-quobyte-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09b9763-8719-4ad1-8e68-ad132435bfc4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:20 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3
Jul 23 03:33:20 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:21 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3" returned: 0 in 0.997s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:21 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3
Jul 23 03:33:21 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:22 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3" returned: 0 in 1.081s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-quobyte-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3" released by "delete_volume" :: held 2.179s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Created reservations ['330f93fe-8994-4f8a-aaf7-a3d8af706a13', 'e70a88a7-8254-4f78-a233-8524fb936f51', '901b153d-1ef0-44e9-9c25-5c19a33c7fc4', 'ffd25bde-de00-4930-a60c-f47ccb48e849'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:23 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:23 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:23 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.477s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:23 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Deleted volume successfully.
Jul 23 03:33:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6da10e1c-cabc-4323-82b7-e952597d66cf tempest-CreateVolumesFromSourceVolumeTest-847207737 None] Lock "cinder-d8f90dce-8aca-4030-825d-dcd4f8c2e2e3-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:24 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d" returned: 0 in 6.408s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088df72-c63f-4e00-b484-924c3015a68a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:24 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:24 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:24 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.627s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:24 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:33:24 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Converted 1024.00 MB image at 159.72 MB/s
Jul 23 03:33:24 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d is being set with open permissions: ugo+rw
Jul 23 03:33:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:24 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d
Jul 23 03:33:24 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:25 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d" returned: 0 in 0.293s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-cd45e25d-4a19-4256-a142-38b40b5c929d" released by "_copy_volume_from_snapshot" :: held 8.451s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-d7557136-0fe3-4fc1-bb3b-a0630860c2eb-cd45e25d-4a19-4256-a142-38b40b5c929d" released by "_create_volume_from_snapshot" :: held 8.504s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.539s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf63cfe4-5c2d-41ce-b844-3a033c40741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd45e25d-4a19-4256-a142-38b40b5c929d', 'volume_size': 1, 'snapshot_id': 'd7557136-0fe3-4fc1-bb3b-a0630860c2eb'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a909ad-e56e-48b1-909a-68056a5f997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:25 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Volume volume-cd45e25d-4a19-4256-a142-38b40b5c929d (cd45e25d-4a19-4256-a142-38b40b5c929d): created successfully
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a909ad-e56e-48b1-909a-68056a5f997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Flow 'volume_create_manager' (b7a79414-32fd-46e9-9e67-292973d3e0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c997b576-3c85-470e-ad6e-8bb2b57ca067 tempest-VolumeDependencyTests-410655859 None] Created volume successfully.
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-d7557136-0fe3-4fc1-bb3b-a0630860c2eb-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-d7557136-0fe3-4fc1-bb3b-a0630860c2eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-quobyte-0d1a9668-887e-466d-8bc6-951e489b087d" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-0d1a9668-887e-466d-8bc6-951e489b087d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-quobyte-d7557136-0fe3-4fc1-bb3b-a0630860c2eb" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-d7557136-0fe3-4fc1-bb3b-a0630860c2eb" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Deleting offline snapshot d7557136-0fe3-4fc1-bb3b-a0630860c2eb of volume 0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] snapshot_file for this snap is: volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd41942-bf7b-4b1a-b463-b2aca9d72b80]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:26 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb
Jul 23 03:33:26 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:26 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb" returned: 0 in 0.536s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d1a9668-887e-466d-8bc6-951e489b087d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:33:26 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b985faa-acbf-4b72-ad33-81938a39b707]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:26 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:26 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:26 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.460s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:27 devstack sudo[106979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb
Jul 23 03:33:27 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:27 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb" returned: 0 in 0.452s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:27 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb
Jul 23 03:33:27 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (2917538b-3312-4df0-b28c-bd3ab2584616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bd1c0f-1fa5-4294-8263-a743f0cc5b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:27 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d.d7557136-0fe3-4fc1-bb3b-a0630860c2eb" returned: 0 in 0.288s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bd1c0f-1fa5-4294-8263-a743f0cc5b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-453209345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9871d4ef-9bc6-4f4c-9628-e69da6b44f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:28Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd63dd6-3b3d-4f37-98df-9c639178322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd63dd6-3b3d-4f37-98df-9c639178322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820a6bc6-298e-4006-a225-45ce636c4e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820a6bc6-298e-4006-a225-45ce636c4e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9871d4ef-9bc6-4f4c-9628-e69da6b44f4c', 'volume_name': 'volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62011242-b074-4da3-b5f4-01343da8a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62011242-b074-4da3-b5f4-01343da8a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90fce35-3638-4813-9ed0-4859ca3b1706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Volume 9871d4ef-9bc6-4f4c-9628-e69da6b44f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c', 'volume_size': 1}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-453209345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9871d4ef-9bc6-4f4c-9628-e69da6b44f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:28Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Creating volume 9871d4ef-9bc6-4f4c-9628-e69da6b44f4c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:27 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:27 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c 1073741824
Jul 23 03:33:27 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-d7557136-0fe3-4fc1-bb3b-a0630860c2eb" released by "_delete_snapshot" :: held 1.959s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:27 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-0d1a9668-887e-466d-8bc6-951e489b087d" released by "delete_snapshot" :: held 2.022s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Created reservations ['989a0b0f-25b9-465a-9961-eb9c003850b1', '03ee6fe8-1bd2-4754-927d-2b20a3ecbda6', 'cb019811-cbcb-4354-9f9d-334cd5a6463c', 'c9313acf-e31c-4d51-88d9-ee9eb78fbd5e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Delete snapshot completed successfully.
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-476c2af3-a18b-493b-ad9d-04c36b95e092 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-d7557136-0fe3-4fc1-bb3b-a0630860c2eb-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:28 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c 1073741824" returned: 0 in 0.645s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:28 devstack sudo[106994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c
Jul 23 03:33:28 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:28 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c" returned: 0 in 0.304s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90fce35-3638-4813-9ed0-4859ca3b1706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1fe3de-2b6b-4968-884c-a8f78ba4caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:28 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Volume volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c (9871d4ef-9bc6-4f4c-9628-e69da6b44f4c): created successfully
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1fe3de-2b6b-4968-884c-a8f78ba4caba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:28 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (2917538b-3312-4df0-b28c-bd3ab2584616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:28 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8ab9cc17-b20a-4143-a7e4-30ba909fce37 tempest-ProjectReaderTests-22644729 None] Created volume successfully.
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-0d1a9668-887e-466d-8bc6-951e489b087d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-0d1a9668-887e-466d-8bc6-951e489b087d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-quobyte-0d1a9668-887e-466d-8bc6-951e489b087d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-0d1a9668-887e-466d-8bc6-951e489b087d" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82a9c30-7491-4680-badf-50959dd5abf4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:29 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:29 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:29 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.462s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:29 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d
Jul 23 03:33:29 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:29 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0d1a9668-887e-466d-8bc6-951e489b087d" returned: 0 in 0.336s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-0d1a9668-887e-466d-8bc6-951e489b087d" released by "delete_volume" :: held 0.882s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=249,cinder:SELECT=193,cinder:INSERT=69,cinder:DELETE=26 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Lock "cinder-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=199,cinder:UPDATE=280,cinder:INSERT=72,cinder:DELETE=22 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-quobyte-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c" acquired by "delete_volume" :: waited 0.033s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Created reservations ['cbf52147-84de-42cc-a4b5-6fbd240d253b', 'abf08ab3-4744-4241-87b0-5e676d89c257', 'd0c4cdcd-7bde-4779-b9a0-3bd284c19319', '29f2ad7f-3f97-43e5-8208-6a3a503e4690'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a173e56a-ab21-4378-90c2-7302af10b2f7]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:30 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:30 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:30 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c
Jul 23 03:33:30 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:30 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.351s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Deleted volume successfully.
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cac31927-771e-482c-8c4e-121c1220de61 tempest-VolumeDependencyTests-410655859 None] Lock "cinder-0d1a9668-887e-466d-8bc6-951e489b087d-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:30 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c" returned: 0 in 0.538s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:30 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c
Jul 23 03:33:30 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c" returned: 0 in 0.319s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:31 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c" released by "delete_volume" :: held 0.937s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Created reservations ['1d7f3911-fe17-4b9f-ab0a-54b6bf8744fd', '659ad14c-34f5-4775-9f07-f359fd13147a', 'cab55e60-92cf-4568-b5b8-01c77cdb9b95', '12dcc11b-7f80-4b07-9a8a-eedf19f9650b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:31 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:31 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-cd45e25d-4a19-4256-a142-38b40b5c929d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Lock "cinder-cd45e25d-4a19-4256-a142-38b40b5c929d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Acquiring lock "cinder-quobyte-cd45e25d-4a19-4256-a142-38b40b5c929d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-cd45e25d-4a19-4256-a142-38b40b5c929d" acquired by "delete_volume" :: waited 0.030s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e43910-64ee-4632-a500-092cd0537c8b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:31 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Deleted volume successfully.
Jul 23 03:33:31 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d
Jul 23 03:33:31 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-60c43b73-fc81-4d5b-ba96-d27c6e8e6fa4 tempest-ProjectReaderTests-22644729 None] Lock "cinder-9871d4ef-9bc6-4f4c-9628-e69da6b44f4c-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:32 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d" returned: 0 in 0.458s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:32 devstack sudo[107026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d
Jul 23 03:33:32 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:32 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cd45e25d-4a19-4256-a142-38b40b5c929d" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Lock "cinder-quobyte-cd45e25d-4a19-4256-a142-38b40b5c929d" released by "delete_volume" :: held 0.854s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Created reservations ['7fdd0651-ef9b-408a-9226-1cb65f0353ee', 'e8567096-2ed4-4192-8b15-54e6e40b45e1', '4e9b8b28-da3a-4931-89a9-8be2b4b87d5e', '404c6d77-b548-4ed0-8661-59c89e210095'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:32 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:32 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:33 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.467s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Deleted volume successfully.
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (f0bd7784-8c36-454d-a785-3c59f8295279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fb5586-53ef-4981-ab1e-fc7ef8694efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-24076a85-cd92-4327-a073-d76c9d0af09f tempest-VolumeDependencyTests-410655859 None] Lock "cinder-cd45e25d-4a19-4256-a142-38b40b5c929d-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fb5586-53ef-4981-ab1e-fc7ef8694efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872111793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b1c094-a0d6-40b7-8f89-efeba50cdf58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:33Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc994bd-959c-47cb-9504-569ecc20ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc994bd-959c-47cb-9504-569ecc20ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85338671-e56d-488d-a579-f89eef59214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85338671-e56d-488d-a579-f89eef59214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b1c094-a0d6-40b7-8f89-efeba50cdf58', 'volume_name': 'volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad3de53-106e-41f0-bde3-1ee8627fb49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad3de53-106e-41f0-bde3-1ee8627fb49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ba194c-e7a1-4986-a54c-ed387476665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Volume 29b1c094-a0d6-40b7-8f89-efeba50cdf58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58', 'volume_size': 1}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1872111793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b1c094-a0d6-40b7-8f89-efeba50cdf58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:33Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Creating volume 29b1c094-a0d6-40b7-8f89-efeba50cdf58 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:33 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:33 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 1073741824
Jul 23 03:33:33 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:33 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 1073741824" returned: 0 in 0.573s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:33 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58
Jul 23 03:33:33 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:34 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58" returned: 0 in 0.350s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ba194c-e7a1-4986-a54c-ed387476665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdc69b-e375-4593-beb0-541d9a97b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:34 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Volume volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 (29b1c094-a0d6-40b7-8f89-efeba50cdf58): created successfully
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdc69b-e375-4593-beb0-541d9a97b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (f0bd7784-8c36-454d-a785-3c59f8295279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6afd57ae-9e09-43f1-80d6-b9e9e8d6709d tempest-ProjectReaderTests-22644729 None] Created volume successfully.
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-29b1c094-a0d6-40b7-8f89-efeba50cdf58-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Lock "cinder-29b1c094-a0d6-40b7-8f89-efeba50cdf58-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-quobyte-29b1c094-a0d6-40b7-8f89-efeba50cdf58" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-29b1c094-a0d6-40b7-8f89-efeba50cdf58" acquired by "delete_volume" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbbbdfd-a90f-4655-9beb-6007288989cc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:35 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58
Jul 23 03:33:35 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:35 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Flow 'volume_create_manager' (72b5f675-cc80-4cd6-a649-0e5985f578b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9dddbf-e6da-4efd-a1cd-f66b398d4cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9dddbf-e6da-4efd-a1cd-f66b398d4cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657163325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe89031-3142-4a87-825e-def3d2f05363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8393debd38645c7854d99d66719db4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:36Z,use_quota=True,user_id='2c788a14ed0e4d93b1280cdd543a6666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a5be4f-edae-4309-938f-84625699da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a5be4f-edae-4309-938f-84625699da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e731b99-e6e3-48ad-aa66-7c9bc9797576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e731b99-e6e3-48ad-aa66-7c9bc9797576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe89031-3142-4a87-825e-def3d2f05363', 'volume_name': 'volume-0fe89031-3142-4a87-825e-def3d2f05363', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:36 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5fa6d5-2874-4d05-9258-b463dd1e6e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5fa6d5-2874-4d05-9258-b463dd1e6e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4445e54-ca20-4e0a-878a-4a533c97c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:36 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Volume 0fe89031-3142-4a87-825e-def3d2f05363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe89031-3142-4a87-825e-def3d2f05363', 'volume_size': 1}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657163325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe89031-3142-4a87-825e-def3d2f05363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8393debd38645c7854d99d66719db4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:36Z,use_quota=True,user_id='2c788a14ed0e4d93b1280cdd543a6666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Creating volume 0fe89031-3142-4a87-825e-def3d2f05363 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:36 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58" returned: 0 in 0.675s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:36 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363 1073741824
Jul 23 03:33:36 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:36 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58
Jul 23 03:33:36 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:36 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-29b1c094-a0d6-40b7-8f89-efeba50cdf58" returned: 0 in 0.367s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-29b1c094-a0d6-40b7-8f89-efeba50cdf58" released by "delete_volume" :: held 1.129s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Created reservations ['49f3e72c-c2a7-4ebb-99f5-8431f9254f14', 'e79ed02c-a4cb-457b-8271-b5d4243c3b3e', '2279917f-5f35-4d26-9681-ca7aad234e4b', 'ec2200ea-1e22-4edb-890b-b18b5dde595b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:36 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363 1073741824" returned: 0 in 0.602s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:36 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:36 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:36 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363
Jul 23 03:33:36 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:37 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.347s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Deleted volume successfully.
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-100817a6-68bd-4e6a-a192-da949ab1bb02 tempest-ProjectReaderTests-22644729 None] Lock "cinder-29b1c094-a0d6-40b7-8f89-efeba50cdf58-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:37 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363" returned: 0 in 0.341s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4445e54-ca20-4e0a-878a-4a533c97c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe89031-3142-4a87-825e-def3d2f05363', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ed6e0-b039-4766-8c04-84e19ee1941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:37 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Volume volume-0fe89031-3142-4a87-825e-def3d2f05363 (0fe89031-3142-4a87-825e-def3d2f05363): created successfully
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ed6e0-b039-4766-8c04-84e19ee1941f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:37 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Flow 'volume_create_manager' (72b5f675-cc80-4cd6-a649-0e5985f578b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:37 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-76c72ccb-8ef4-4d55-9b68-67fdd823e6cb tempest-ProjectReaderTests-276558070 None] Created volume successfully.
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (6141a63d-8ef5-417d-a8da-b89c58465da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8042754-88e4-4483-a43e-3c41bf37b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8042754-88e4-4483-a43e-3c41bf37b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787274693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e062608-d841-4379-947a-9931669f0918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:38Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539b7a65-a0fe-417f-8be5-8d92bc7538a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539b7a65-a0fe-417f-8be5-8d92bc7538a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef913c2-1e82-429e-a4e4-4fd6ec07403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef913c2-1e82-429e-a4e4-4fd6ec07403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e062608-d841-4379-947a-9931669f0918', 'volume_name': 'volume-0e062608-d841-4379-947a-9931669f0918', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a41c16c-0f72-43b8-85c0-1665e5cca29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a41c16c-0f72-43b8-85c0-1665e5cca29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06653d2d-2c00-48dc-aeb1-d3fedffe5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Volume 0e062608-d841-4379-947a-9931669f0918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e062608-d841-4379-947a-9931669f0918', 'volume_size': 1}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787274693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e062608-d841-4379-947a-9931669f0918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:38Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Creating volume 0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:38 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:38 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 1073741824
Jul 23 03:33:38 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Acquiring lock "cinder-0fe89031-3142-4a87-825e-def3d2f05363-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (c75b173f-2cdf-45bb-834e-8c5530ef6ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21a96c9-cfd2-4487-949f-2271b0e9db38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Lock "cinder-0fe89031-3142-4a87-825e-def3d2f05363-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21a96c9-cfd2-4487-949f-2271b0e9db38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461757773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a51367-331e-4190-85e6-f20ff79f2013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:38Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cb44f9-a691-43e9-97df-4c832849b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cb44f9-a691-43e9-97df-4c832849b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3b5e62-ceea-4c42-8145-a2bfd2b30bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3b5e62-ceea-4c42-8145-a2bfd2b30bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a51367-331e-4190-85e6-f20ff79f2013', 'volume_name': 'volume-d7a51367-331e-4190-85e6-f20ff79f2013', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2422f26c-3f74-42a2-8388-52cdd16137ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2422f26c-3f74-42a2-8388-52cdd16137ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83270414-da38-460d-b2bf-8363fe05ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:38 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Volume d7a51367-331e-4190-85e6-f20ff79f2013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a51367-331e-4190-85e6-f20ff79f2013', 'volume_size': 1}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Acquiring lock "cinder-quobyte-0fe89031-3142-4a87-825e-def3d2f05363" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Lock "cinder-quobyte-0fe89031-3142-4a87-825e-def3d2f05363" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3315ba-afa3-4cd8-855b-b9a2ff4b398e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:38 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363
Jul 23 03:33:38 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:38 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 1073741824" returned: 0 in 0.756s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:38 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918
Jul 23 03:33:38 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:39 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363" returned: 0 in 0.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:39 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363
Jul 23 03:33:39 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:39 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918" returned: 0 in 0.263s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461757773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a51367-331e-4190-85e6-f20ff79f2013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:38Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Creating volume d7a51367-331e-4190-85e6-f20ff79f2013 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:39 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:39 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013 1073741824
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06653d2d-2c00-48dc-aeb1-d3fedffe5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e062608-d841-4379-947a-9931669f0918', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:39 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b16a817-8853-43b7-8b48-73fc62256d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:39 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Volume volume-0e062608-d841-4379-947a-9931669f0918 (0e062608-d841-4379-947a-9931669f0918): created successfully
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b16a817-8853-43b7-8b48-73fc62256d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (6141a63d-8ef5-417d-a8da-b89c58465da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-12f04ee8-ac69-47bc-8fc9-4946d1d3acd7 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:33:39 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0fe89031-3142-4a87-825e-def3d2f05363" returned: 0 in 0.310s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Lock "cinder-quobyte-0fe89031-3142-4a87-825e-def3d2f05363" released by "delete_volume" :: held 0.762s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Created reservations ['65cd2724-df92-418c-8ef3-bd5fc13a4887', '4d7a0f83-3d92-4f43-8e6b-0ef18feca76d', 'b03e967b-ada3-4fce-ae4d-881322af7db7', '70d7072f-e80e-47f7-a654-6657902a98ed'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:39 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:39 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:39 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013 1073741824" returned: 0 in 0.573s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:39 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013
Jul 23 03:33:39 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:39 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.300s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:39 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Deleted volume successfully.
Jul 23 03:33:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-70f441c3-35e3-4814-99a1-32eefafe946b tempest-ProjectReaderTests-276558070 None] Lock "cinder-0fe89031-3142-4a87-825e-def3d2f05363-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:40 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013" returned: 0 in 0.305s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83270414-da38-460d-b2bf-8363fe05ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a51367-331e-4190-85e6-f20ff79f2013', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8411f4-2faa-4793-ab55-6799e062f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Volume volume-d7a51367-331e-4190-85e6-f20ff79f2013 (d7a51367-331e-4190-85e6-f20ff79f2013): created successfully
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8411f4-2faa-4793-ab55-6799e062f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (c75b173f-2cdf-45bb-834e-8c5530ef6ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8eb2a66b-f081-4b45-bb73-feb5c34156de tempest-ProjectReaderTests-22644729 None] Created volume successfully.
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Flow 'volume_create_manager' (8f3822f1-fd38-4984-be96-2741dad52ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cda5b8-bf9d-45c5-a995-40da95a523ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cda5b8-bf9d-45c5-a995-40da95a523ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519463524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8393debd38645c7854d99d66719db4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:40Z,use_quota=True,user_id='2c788a14ed0e4d93b1280cdd543a6666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f225785d-8651-4b16-ac51-a95d89634d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f225785d-8651-4b16-ac51-a95d89634d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeaa578-96f9-48ed-be6e-9b83b18b859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeaa578-96f9-48ed-be6e-9b83b18b859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd', 'volume_name': 'volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99139a84-3888-4145-b132-7f38f506b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99139a84-3888-4145-b132-7f38f506b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daf80f7-1e3a-4883-82cd-ffe3c3294e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Volume 7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd', 'volume_size': 1}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519463524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8393debd38645c7854d99d66719db4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:40Z,use_quota=True,user_id='2c788a14ed0e4d93b1280cdd543a6666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Creating volume 7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:40 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-d7a51367-331e-4190-85e6-f20ff79f2013-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:40 devstack sudo[107127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd 1073741824
Jul 23 03:33:40 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Lock "cinder-d7a51367-331e-4190-85e6-f20ff79f2013-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-quobyte-d7a51367-331e-4190-85e6-f20ff79f2013" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-d7a51367-331e-4190-85e6-f20ff79f2013" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaee369-4a9f-4eba-9956-505eb1313618]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:40 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013
Jul 23 03:33:40 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:41 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd 1073741824" returned: 0 in 0.589s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:41 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013" returned: 0 in 0.561s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:41 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd
Jul 23 03:33:41 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:41 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013
Jul 23 03:33:41 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:41 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd" returned: 0 in 0.286s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.910s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Creating offline snapshot 526b0b8a-1a87-4723-aaac-6e5574be5e2c of volume 0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daf80f7-1e3a-4883-82cd-ffe3c3294e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b6a03a-4d59-4119-9557-7c8c9f928355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:41 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-d7a51367-331e-4190-85e6-f20ff79f2013" returned: 0 in 0.312s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613105b-cc44-4a4d-92f9-7fa382fe08ba]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Volume volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd (7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd): created successfully
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b6a03a-4d59-4119-9557-7c8c9f928355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Flow 'volume_create_manager' (8f3822f1-fd38-4984-be96-2741dad52ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-d7a51367-331e-4190-85e6-f20ff79f2013" released by "delete_volume" :: held 0.947s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d85aa983-4f0b-42cc-b3d5-59295b0304fc tempest-ProjectReaderTests-276558070 None] Created volume successfully.
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Created reservations ['0c13f25b-3230-413e-91e4-46e7a1a709e4', '7da4c72b-68b7-4143-9702-1246deff5cb5', '87432deb-3cd7-4c60-8218-098fd1a8b85d', 'a6967fea-da2f-45d7-8093-d04a6e5fc2c5'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:41 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918
Jul 23 03:33:41 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:41 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:41 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:42 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918" returned: 0 in 0.428s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:42 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c 1G
Jul 23 03:33:42 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:42 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.281s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:42 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Deleted volume successfully.
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-80675e13-96b8-49a7-bf9c-1a87daaede88 tempest-ProjectReaderTests-22644729 None] Lock "cinder-d7a51367-331e-4190-85e6-f20ff79f2013-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Acquiring lock "cinder-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Lock "cinder-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Acquiring lock "cinder-quobyte-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:42 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c 1G" returned: 0 in 0.553s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e062608-d841-4379-947a-9931669f0918 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Lock "cinder-quobyte-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd" acquired by "delete_volume" :: waited 0.032s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:42 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e062608-d841-4379-947a-9931669f0918 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c
Jul 23 03:33:42 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[116892ef-e42b-446a-a201-a1d29a147c0f]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:42 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd
Jul 23 03:33:42 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:42 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e062608-d841-4379-947a-9931669f0918 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:42 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c is being set with open permissions: ugo+rw
Jul 23 03:33:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:42 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c
Jul 23 03:33:43 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:43 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd" returned: 0 in 0.445s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:43 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd
Jul 23 03:33:43 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:43 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c" returned: 0 in 0.393s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:43 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info
Jul 23 03:33:43 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (0241d404-d034-4409-b68d-01cc8f1a6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f301aad1-d139-4c9e-8585-fe17e7922d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f301aad1-d139-4c9e-8585-fe17e7922d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171833984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faa59d3-5c9c-4302-9d20-d5f705c0f252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:43Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f832c9f-8acc-4746-917d-74c7751ac880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f832c9f-8acc-4746-917d-74c7751ac880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345bbd7-3414-4893-bbf6-cb2b325d246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345bbd7-3414-4893-bbf6-cb2b325d246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9faa59d3-5c9c-4302-9d20-d5f705c0f252', 'volume_name': 'volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584183ab-3f7b-41cc-931a-eb6da244b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:43 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584183ab-3f7b-41cc-931a-eb6da244b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd0316a-ec1e-47f1-a003-adef7109449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:43 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Volume 9faa59d3-5c9c-4302-9d20-d5f705c0f252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252', 'volume_size': 1}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd" returned: 0 in 0.448s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Lock "cinder-quobyte-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd" released by "delete_volume" :: held 0.937s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Created reservations ['d43b1979-3f02-4576-bc48-a7b75b0c8c34', 'efa4e77b-26d6-4945-8828-41dbe5fff048', 'd519c11c-b113-4e10-8e2f-eb1f05313c01', 'c0a124c5-06c8-4609-8c8f-fe6fc7ac8752'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:43 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:43 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:43 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:43 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info is being set with open permissions: ugo+rw
Jul 23 03:33:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:43 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info
Jul 23 03:33:43 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:44 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.287s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Deleted volume successfully.
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09d24d55-c315-4940-92c4-969b9f7f12a5 tempest-ProjectReaderTests-276558070 None] Lock "cinder-7a6ff39a-29b0-4d45-92b0-7a1ace75f2dd-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:44 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.info" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171833984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faa59d3-5c9c-4302-9d20-d5f705c0f252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdb74ba0df04b4295238105c647a5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:43Z,use_quota=True,user_id='59aa389a3ea2465a8b27c9d4ea82ddc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Creating volume 9faa59d3-5c9c-4302-9d20-d5f705c0f252 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:44 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:44 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 1073741824
Jul 23 03:33:44 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:44 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-acd4b150-f71d-4e76-a4cd-19015160c00b tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:33:44 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 1073741824" returned: 0 in 0.464s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:44 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252
Jul 23 03:33:44 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-526b0b8a-1a87-4723-aaac-6e5574be5e2c-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-526b0b8a-1a87-4723-aaac-6e5574be5e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-0e062608-d841-4379-947a-9931669f0918" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-0e062608-d841-4379-947a-9931669f0918" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-526b0b8a-1a87-4723-aaac-6e5574be5e2c" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-526b0b8a-1a87-4723-aaac-6e5574be5e2c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot 526b0b8a-1a87-4723-aaac-6e5574be5e2c of volume 0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6433288a-5765-44ef-8da6-f9f306c05ce2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:44 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252" returned: 0 in 0.370s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd0316a-ec1e-47f1-a003-adef7109449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:44 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1457ea6-7e3b-468e-95df-4c2229268b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:45 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Volume volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 (9faa59d3-5c9c-4302-9d20-d5f705c0f252): created successfully
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1457ea6-7e3b-468e-95df-4c2229268b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:45 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c
Jul 23 03:33:45 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Flow 'volume_create_manager' (0241d404-d034-4409-b68d-01cc8f1a6318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4d8c6e43-487c-465c-ac9f-2ec8a3128c8b tempest-ProjectReaderTests-22644729 None] Created volume successfully.
Jul 23 03:33:45 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c" returned: 0 in 0.475s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e062608-d841-4379-947a-9931669f0918(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb208f8-be91-4f14-a9b9-96d495674768]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:45 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918
Jul 23 03:33:45 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-9faa59d3-5c9c-4302-9d20-d5f705c0f252-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Lock "cinder-9faa59d3-5c9c-4302-9d20-d5f705c0f252-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Acquiring lock "cinder-quobyte-9faa59d3-5c9c-4302-9d20-d5f705c0f252" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-9faa59d3-5c9c-4302-9d20-d5f705c0f252" acquired by "delete_volume" :: waited 0.021s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a20d579-1a36-4464-adf4-50708a972a8b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:45 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252
Jul 23 03:33:45 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:45 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918" returned: 0 in 0.594s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:46 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c
Jul 23 03:33:46 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:46 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252" returned: 0 in 0.469s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:46 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252
Jul 23 03:33:46 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:46 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c" returned: 0 in 0.579s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:46 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:46 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9faa59d3-5c9c-4302-9d20-d5f705c0f252" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:46 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Lock "cinder-quobyte-9faa59d3-5c9c-4302-9d20-d5f705c0f252" released by "delete_volume" :: held 0.826s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Created reservations ['4d9d7531-4bc4-4a91-a8d0-b251de5fc5fa', '6040ee34-1800-440d-b737-6ad454855768', 'e43be2dd-98e2-4a12-bec8-7857cdd13bea', '682958b4-2009-4e47-9502-a3551d6fd6c2'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:46 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:46 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:46 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918.526b0b8a-1a87-4723-aaac-6e5574be5e2c" returned: 0 in 0.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-526b0b8a-1a87-4723-aaac-6e5574be5e2c" released by "_delete_snapshot" :: held 2.219s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-0e062608-d841-4379-947a-9931669f0918" released by "delete_snapshot" :: held 2.251s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:47 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.334s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Deleted volume successfully.
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dfdf122-df8c-4b18-817d-4af9dd4b6e08 tempest-ProjectReaderTests-22644729 None] Lock "cinder-9faa59d3-5c9c-4302-9d20-d5f705c0f252-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Created reservations ['4a1fb67f-4ea3-41eb-bdb8-e1d4bf24fc57', '7844be8d-351a-4300-b330-c436ddcc20a9', 'd0a951b7-3469-470c-afeb-dca69986f584', '44653f4c-56d8-40f6-afa0-e90d7f6e040e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:33:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-75794870-5295-4670-b7f0-d3c1d900b5a1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-526b0b8a-1a87-4723-aaac-6e5574be5e2c-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-0e062608-d841-4379-947a-9931669f0918-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Lock "cinder-0e062608-d841-4379-947a-9931669f0918-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-0e062608-d841-4379-947a-9931669f0918" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-0e062608-d841-4379-947a-9931669f0918" acquired by "delete_volume" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb39d6d-0482-4cef-a9a1-2b4e298140dc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:48 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918
Jul 23 03:33:48 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:48 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918" returned: 0 in 0.459s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:48 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918
Jul 23 03:33:48 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:48 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-0e062608-d841-4379-947a-9931669f0918" returned: 0 in 0.345s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-0e062608-d841-4379-947a-9931669f0918" released by "delete_volume" :: held 0.882s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Created reservations ['cf27a79d-10e7-431c-9e8f-28b81059256c', '6d274fa6-c11c-42dc-a195-ae96bafe5c85', 'c6f43845-6701-47a5-b52b-f75c03037a11', '786bfcd2-4da2-44b9-b8c7-54b19eae4488'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:49 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:49 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:49 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:49 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1cbc44e2-6dbb-46eb-b02d-88b65e143131 tempest-ProjectMemberTests-344425068 None] Lock "cinder-0e062608-d841-4379-947a-9931669f0918-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (c02e8311-7d49-4914-a4fb-febb3bbd5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b71a2b7-3db5-4f83-a20f-8c18681006f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b71a2b7-3db5-4f83-a20f-8c18681006f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492855256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5b965e-3230-4eee-a879-0d2551522d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:50Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343b1daf-ee38-437a-afb8-99d82327d4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343b1daf-ee38-437a-afb8-99d82327d4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ff73d0-def8-479c-bf8a-426f7d9b1905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ff73d0-def8-479c-bf8a-426f7d9b1905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5b965e-3230-4eee-a879-0d2551522d9a', 'volume_name': 'volume-5c5b965e-3230-4eee-a879-0d2551522d9a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e31e9c-5d7a-4460-849c-8dc6b26ff503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e31e9c-5d7a-4460-849c-8dc6b26ff503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f967531c-c27a-49d0-9649-7070d8571441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:49 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Volume 5c5b965e-3230-4eee-a879-0d2551522d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5b965e-3230-4eee-a879-0d2551522d9a', 'volume_size': 1}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492855256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5b965e-3230-4eee-a879-0d2551522d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:50Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Creating volume 5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:49 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:49 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a 1073741824
Jul 23 03:33:49 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:50 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a 1073741824" returned: 0 in 0.521s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:50 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a
Jul 23 03:33:50 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:50 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a" returned: 0 in 0.307s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f967531c-c27a-49d0-9649-7070d8571441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5b965e-3230-4eee-a879-0d2551522d9a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223020dc-12a5-460e-b190-a2284968ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:50 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Volume volume-5c5b965e-3230-4eee-a879-0d2551522d9a (5c5b965e-3230-4eee-a879-0d2551522d9a): created successfully
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223020dc-12a5-460e-b190-a2284968ca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:50 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (c02e8311-7d49-4914-a4fb-febb3bbd5454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fc46317d-242d-474d-b135-b2030b6743a0 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Creating offline snapshot b8a291db-5fda-4a04-9d28-05d8a8831416 of volume 5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fbc627-f200-4f5d-a494-3d60b8cafb7d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:52 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a
Jul 23 03:33:52 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:52 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:52 devstack sudo[107256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 1G
Jul 23 03:33:52 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:53 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 1G" returned: 0 in 0.442s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5b965e-3230-4eee-a879-0d2551522d9a -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:53 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5b965e-3230-4eee-a879-0d2551522d9a -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416
Jul 23 03:33:53 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:53 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5b965e-3230-4eee-a879-0d2551522d9a -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:53 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 is being set with open permissions: ugo+rw
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:53 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416
Jul 23 03:33:53 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:53 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416" returned: 0 in 0.285s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:53 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info
Jul 23 03:33:53 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:53 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info" returned: 0 in 0.279s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:53 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info is being set with open permissions: ugo+rw
Jul 23 03:33:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:54 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info
Jul 23 03:33:54 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:54 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.info" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a857bc5f-730b-4596-b498-162440dfe4f5 tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-b8a291db-5fda-4a04-9d28-05d8a8831416-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Lock "cinder-b8a291db-5fda-4a04-9d28-05d8a8831416-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-5c5b965e-3230-4eee-a879-0d2551522d9a" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-5c5b965e-3230-4eee-a879-0d2551522d9a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-b8a291db-5fda-4a04-9d28-05d8a8831416" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-b8a291db-5fda-4a04-9d28-05d8a8831416" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot b8a291db-5fda-4a04-9d28-05d8a8831416 of volume 5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597d6fa-11c3-4adc-9de3-cc3f99a8156a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:55 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416
Jul 23 03:33:55 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:55 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416" returned: 0 in 0.388s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c5b965e-3230-4eee-a879-0d2551522d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188d561-257c-4b49-a860-a0410b27b242]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:55 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:56 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a
Jul 23 03:33:56 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:56 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a" returned: 0 in 0.434s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:56 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416
Jul 23 03:33:56 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:56 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416" returned: 0 in 0.387s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:56 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416
Jul 23 03:33:56 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:56 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:56 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a.b8a291db-5fda-4a04-9d28-05d8a8831416" returned: 0 in 0.277s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-b8a291db-5fda-4a04-9d28-05d8a8831416" released by "_delete_snapshot" :: held 1.623s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-5c5b965e-3230-4eee-a879-0d2551522d9a" released by "delete_snapshot" :: held 1.656s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Created reservations ['de06dcf5-f06d-412f-a939-5328b6c3c703', 'da7a0250-75d0-4b78-a66f-ab27767ec8a2', '26fb06f1-4a94-4ddb-89a3-d982f1d9e178', '07f23e2c-4508-43a4-a426-cb5b9c6a207e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:57 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-9f7ddbfb-6a12-44dd-bd79-e09d9cb177b8 tempest-ProjectMemberTests-344425068 None] Lock "cinder-b8a291db-5fda-4a04-9d28-05d8a8831416-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-5c5b965e-3230-4eee-a879-0d2551522d9a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Lock "cinder-5c5b965e-3230-4eee-a879-0d2551522d9a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-5c5b965e-3230-4eee-a879-0d2551522d9a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-5c5b965e-3230-4eee-a879-0d2551522d9a" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[403e63d0-ac97-4f30-95a3-a824fec5b87b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:33:57 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:57 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a
Jul 23 03:33:57 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:58 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a" returned: 0 in 0.402s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:58 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a
Jul 23 03:33:58 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:58 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-5c5b965e-3230-4eee-a879-0d2551522d9a" returned: 0 in 0.255s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-5c5b965e-3230-4eee-a879-0d2551522d9a" released by "delete_volume" :: held 0.716s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Created reservations ['81c659d7-d151-4a60-b566-6391992bc7c6', 'c5af6af7-33b4-4e4f-b1ad-447ca1263ff9', 'd41284f5-b648-4ff5-b087-2f3b70d4803c', '2597bb2e-5513-4e5a-9332-b060106b7570'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:58 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:58 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:58 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.325s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:33:58 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:33:58 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:58 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-5250bb6e-5dc2-43e2-8c02-9893e0279e55 tempest-ProjectMemberTests-344425068 None] Lock "cinder-5c5b965e-3230-4eee-a879-0d2551522d9a-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:33:59 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.415s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (5dcb469a-96b6-45e4-863c-d98e858607fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90153d4f-cb22-4c52-ab1e-32759c810016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90153d4f-cb22-4c52-ab1e-32759c810016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426528029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:59Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1c3d5-bdc2-44e0-ad8e-7a6384521fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1c3d5-bdc2-44e0-ad8e-7a6384521fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803d7bc8-df4c-4f14-9081-e2d001b9751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803d7bc8-df4c-4f14-9081-e2d001b9751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2', 'volume_name': 'volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3cd61a-05ad-4d14-84c3-ab8ce6b6b805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3cd61a-05ad-4d14-84c3-ab8ce6b6b805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce884cd0-4965-4977-8773-ca5cc59ac1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:33:59 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Volume c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2', 'volume_size': 1}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426528029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:59Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Creating volume c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:33:59 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:33:59 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 1073741824
Jul 23 03:33:59 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:33:59 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Jul 23 03:33:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 1073741824" returned: 0 in 0.484s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Flow 'volume_create_manager' (62067705-faf8-41bf-8f93-3a8394dd8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6bd472-65df-42f3-80de-e30d1a83bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6bd472-65df-42f3-80de-e30d1a83bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2029367122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e3f00-c2a1-466b-9067-b18d94da4e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4317567e614146ada8a9786687288c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:00Z,use_quota=True,user_id='ab7588dfce3140e7ad555fcf9be5390d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d8d807-9fb4-4976-8978-d06249209d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d8d807-9fb4-4976-8978-d06249209d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb220cb0-6acb-4dbf-a9f2-559c40fc5f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb220cb0-6acb-4dbf-a9f2-559c40fc5f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871e3f00-c2a1-466b-9067-b18d94da4e78', 'volume_name': 'volume-871e3f00-c2a1-466b-9067-b18d94da4e78', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca81da9-9f73-4d15-98e5-b2cb967c5e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca81da9-9f73-4d15-98e5-b2cb967c5e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d175ad-120c-4983-88d5-24e913c943c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:00 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Volume 871e3f00-c2a1-466b-9067-b18d94da4e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871e3f00-c2a1-466b-9067-b18d94da4e78', 'volume_size': 1}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:00 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2
Jul 23 03:34:00 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:00 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2029367122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e3f00-c2a1-466b-9067-b18d94da4e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4317567e614146ada8a9786687288c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:00Z,use_quota=True,user_id='ab7588dfce3140e7ad555fcf9be5390d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Creating volume 871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:00 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce884cd0-4965-4977-8773-ca5cc59ac1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:00 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 1073741824
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9869b2-2d03-4879-ba83-3e59cc5147f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:00 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:00 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Volume volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 (c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2): created successfully
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9869b2-2d03-4879-ba83-3e59cc5147f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (5dcb469a-96b6-45e4-863c-d98e858607fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7a9b442e-2212-4c31-8e11-ae2371562db3 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:00 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 1073741824" returned: 0 in 0.396s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:00 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:00 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:01 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.233s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d175ad-120c-4983-88d5-24e913c943c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871e3f00-c2a1-466b-9067-b18d94da4e78', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d77d0f-0e9f-4714-9835-b06de3336962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:01 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Volume volume-871e3f00-c2a1-466b-9067-b18d94da4e78 (871e3f00-c2a1-466b-9067-b18d94da4e78): created successfully
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d77d0f-0e9f-4714-9835-b06de3336962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Flow 'volume_create_manager' (62067705-faf8-41bf-8f93-3a8394dd8db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:01 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-72021ddb-a299-4266-ac86-95907b63423d tempest-SnapshotDependencyTests-1057838581 None] Created volume successfully.
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Creating offline snapshot 1f6f1fd0-2105-4053-8792-e7daeb625b32 of volume c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ad9c3-645b-476e-a8e6-19b1b3a43547]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:01 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2
Jul 23 03:34:01 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:01 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:02 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 1G
Jul 23 03:34:02 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:02 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 1G" returned: 0 in 0.451s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:02 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32
Jul 23 03:34:02 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:02 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:02 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 is being set with open permissions: ugo+rw
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:02 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32
Jul 23 03:34:02 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:02 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32" returned: 0 in 0.224s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:02 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info
Jul 23 03:34:02 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:03 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info" returned: 0 in 0.226s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:03 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info is being set with open permissions: ugo+rw
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:03 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info
Jul 23 03:34:03 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:03 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.info" returned: 0 in 0.227s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.050s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Creating offline snapshot f9487913-82e2-4a76-92fe-0d9525853c91 of volume 871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:03 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ffe51703-d525-44a6-9b9f-daf93072a617 tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[750eb857-2028-4494-aa63-5611892312ec]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:03 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:03 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-1f6f1fd0-2105-4053-8792-e7daeb625b32-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Lock "cinder-1f6f1fd0-2105-4053-8792-e7daeb625b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-1f6f1fd0-2105-4053-8792-e7daeb625b32" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-1f6f1fd0-2105-4053-8792-e7daeb625b32" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot 1f6f1fd0-2105-4053-8792-e7daeb625b32 of volume c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:03 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.372s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d191a86-5502-4996-8621-6f74b7e9cf62]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:03 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 1G
Jul 23 03:34:03 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:03 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32
Jul 23 03:34:03 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:04 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:04 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 1G" returned: 0 in 0.400s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871e3f00-c2a1-466b-9067-b18d94da4e78 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de6bc7-06ea-4f0b-9d60-28c427c703f2]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:04 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871e3f00-c2a1-466b-9067-b18d94da4e78 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91
Jul 23 03:34:04 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:04 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2
Jul 23 03:34:04 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:04 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871e3f00-c2a1-466b-9067-b18d94da4e78 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91" returned: 0 in 0.299s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:04 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 is being set with open permissions: ugo+rw
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:04 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91
Jul 23 03:34:04 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:04 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" returned: 0 in 0.398s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:04 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32
Jul 23 03:34:04 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:04 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91" returned: 0 in 0.258s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:04 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info
Jul 23 03:34:04 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:05 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32" returned: 0 in 0.341s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:05 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32
Jul 23 03:34:05 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:05 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info" returned: 0 in 0.275s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:05 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info is being set with open permissions: ugo+rw
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:05 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info
Jul 23 03:34:05 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:05 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2.1f6f1fd0-2105-4053-8792-e7daeb625b32" returned: 0 in 0.270s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-1f6f1fd0-2105-4053-8792-e7daeb625b32" released by "_delete_snapshot" :: held 1.490s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" released by "delete_snapshot" :: held 1.516s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Created reservations ['fa485e76-1cea-46f8-b4d9-96dcaf0c4c2e', '0626d7b6-d512-4e50-80fa-7fa84defcdcf', '00f4ad4f-7cd0-4e1e-be48-1e4be06c9728', '9fd786bb-0d1b-47f5-9628-097829c7e1b3'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:05 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.info" returned: 0 in 0.260s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e7ab84f6-98b1-4e05-b48c-e86ad26a3c92 tempest-SnapshotDependencyTests-1057838581 None] Create snapshot completed successfully
Jul 23 03:34:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-53905bd7-659c-4937-9454-c34f31e31141 tempest-ProjectMemberTests-344425068 None] Lock "cinder-1f6f1fd0-2105-4053-8792-e7daeb625b32-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:05 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Lock "cinder-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8eac00-538b-4452-8513-222bafeffc19]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Flow 'volume_create_manager' (7015669e-4208-474a-9689-4ccf0f82128d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608396f5-e56b-4818-873d-e991d8512bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608396f5-e56b-4818-873d-e991d8512bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a048f1-fcd5-4eba-9a2f-761df2b5a244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4317567e614146ada8a9786687288c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9487913-82e2-4a76-92fe-0d9525853c91,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:06Z,use_quota=True,user_id='ab7588dfce3140e7ad555fcf9be5390d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:06 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3545c86f-7558-4157-b4f2-68152b19507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:06 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3545c86f-7558-4157-b4f2-68152b19507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947d83f4-800e-4689-a6e8-7d4439da0bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947d83f4-800e-4689-a6e8-7d4439da0bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78a048f1-fcd5-4eba-9a2f-761df2b5a244', 'volume_name': 'volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244', 'volume_size': 1, 'snapshot_id': 'f9487913-82e2-4a76-92fe-0d9525853c91'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500569cc-6216-44a2-8763-13329eba8d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500569cc-6216-44a2-8763-13329eba8d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845067cd-7b1a-4a91-a963-32c54d9271d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:06 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Volume 78a048f1-fcd5-4eba-9a2f-761df2b5a244: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244', 'volume_size': 1, 'snapshot_id': 'f9487913-82e2-4a76-92fe-0d9525853c91'}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-quobyte-f9487913-82e2-4a76-92fe-0d9525853c91-78a048f1-fcd5-4eba-9a2f-761df2b5a244" by "_create_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-f9487913-82e2-4a76-92fe-0d9525853c91-78a048f1-fcd5-4eba-9a2f-761df2b5a244" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Creating volume 78a048f1-fcd5-4eba-9a2f-761df2b5a244 from snapshot f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-quobyte-78a048f1-fcd5-4eba-9a2f-761df2b5a244" by "_copy_volume_from_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-78a048f1-fcd5-4eba-9a2f-761df2b5a244" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] snapshot: f9487913-82e2-4a76-92fe-0d9525853c91, volume: 78a048f1-fcd5-4eba-9a2f-761df2b5a244,  {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4590e2d1-74c1-454c-a150-7d17fffd0eb1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:06 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91
Jul 23 03:34:06 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:06 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" returned: 0 in 0.368s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:06 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2
Jul 23 03:34:06 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:06 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91" returned: 0 in 0.348s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-871e3f00-c2a1-466b-9067-b18d94da4e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Creating direct copy from snapshot {{(pid=88344) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa7a635-3df6-4f48-ba00-8119c6c27078]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:06 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" returned: 0 in 0.258s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2" released by "delete_volume" :: held 0.687s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Created reservations ['58bed8dd-8d48-4568-8455-a6f5fea63246', 'dcefa945-f79b-4963-b08d-96dffeffaa6f', '4906e056-4860-4744-bb2b-af571708730f', '13fdc9eb-aa3c-4a31-b8ec-8b595f174110'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:06 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:06 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:06 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:06 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:07 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.420s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.utils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Path /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 not found in is_blk_device check {{(pid=88344) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:07 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:07 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244
Jul 23 03:34:07 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-56137151-ff1c-4965-ac7e-15eabf04403b tempest-ProjectMemberTests-344425068 None] Lock "cinder-c0a5e512-7387-42a8-8a8b-9b63f5aa6bc2-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (88888d00-4790-4ef8-9da5-24a3be438ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba26020-5a10-4162-bd61-4fea88ed03b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba26020-5a10-4162-bd61-4fea88ed03b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831874983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d297e37-9399-444f-a24c-222dc4ce4f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:08Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15f2f55-8d3b-4de6-85c5-cc6921d9600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15f2f55-8d3b-4de6-85c5-cc6921d9600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220bdbb1-f50a-4781-85cf-f1b786f92b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220bdbb1-f50a-4781-85cf-f1b786f92b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d297e37-9399-444f-a24c-222dc4ce4f28', 'volume_name': 'volume-8d297e37-9399-444f-a24c-222dc4ce4f28', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44390021-3ca6-4537-9507-e287523200ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44390021-3ca6-4537-9507-e287523200ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0389713-8720-4a84-ad68-2b723a19f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:07 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Volume 8d297e37-9399-444f-a24c-222dc4ce4f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d297e37-9399-444f-a24c-222dc4ce4f28', 'volume_size': 1}
Jul 23 03:34:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:11 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244" returned: 0 in 4.113s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3720ac9-b65d-4110-978c-53551c632724]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:11 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:11 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:11 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.525s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG cinder.image.image_utils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Image conversion details: src /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78, size 1024.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 {{(pid=88344) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 23 03:34:11 devstack cinder-volume[88344]: INFO cinder.image.image_utils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Converted 1024.00 MB image at 248.91 MB/s
Jul 23 03:34:11 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 is being set with open permissions: ugo+rw
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:11 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244
Jul 23 03:34:11 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:11 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244" returned: 0 in 0.238s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-78a048f1-fcd5-4eba-9a2f-761df2b5a244" released by "_copy_volume_from_snapshot" :: held 5.733s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-f9487913-82e2-4a76-92fe-0d9525853c91-78a048f1-fcd5-4eba-9a2f-761df2b5a244" released by "_create_volume_from_snapshot" :: held 5.763s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.781s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.280s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831874983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d297e37-9399-444f-a24c-222dc4ce4f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:08Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Creating volume 8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:12 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:12 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 1073741824
Jul 23 03:34:12 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845067cd-7b1a-4a91-a963-32c54d9271d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244', 'volume_size': 1, 'snapshot_id': 'f9487913-82e2-4a76-92fe-0d9525853c91'}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebffb7c2-2ca8-469d-a8a9-109500c1060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Volume volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 (78a048f1-fcd5-4eba-9a2f-761df2b5a244): created successfully
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebffb7c2-2ca8-469d-a8a9-109500c1060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Flow 'volume_create_manager' (7015669e-4208-474a-9689-4ccf0f82128d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-09878498-a0ee-4c2a-9ecb-dadaaa9af691 tempest-SnapshotDependencyTests-1057838581 None] Created volume successfully.
Jul 23 03:34:12 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 1073741824" returned: 0 in 0.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:12 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28
Jul 23 03:34:12 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:12 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28" returned: 0 in 0.230s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0389713-8720-4a84-ad68-2b723a19f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d297e37-9399-444f-a24c-222dc4ce4f28', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92010a2d-e7a8-472e-bba6-0b03b3d31ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Volume volume-8d297e37-9399-444f-a24c-222dc4ce4f28 (8d297e37-9399-444f-a24c-222dc4ce4f28): created successfully
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92010a2d-e7a8-472e-bba6-0b03b3d31ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (88888d00-4790-4ef8-9da5-24a3be438ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-553f4731-63b0-42b4-9afb-c83a72ad581f tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-f9487913-82e2-4a76-92fe-0d9525853c91-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-f9487913-82e2-4a76-92fe-0d9525853c91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-quobyte-871e3f00-c2a1-466b-9067-b18d94da4e78" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-871e3f00-c2a1-466b-9067-b18d94da4e78" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-quobyte-f9487913-82e2-4a76-92fe-0d9525853c91" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-f9487913-82e2-4a76-92fe-0d9525853c91" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Deleting offline snapshot f9487913-82e2-4a76-92fe-0d9525853c91 of volume 871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] snapshot_file for this snap is: volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c928856-1cef-47e9-8da5-c5a13f5f335e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:13 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91
Jul 23 03:34:13 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:13 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-871e3f00-c2a1-466b-9067-b18d94da4e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[30017738-cbff-4a69-a986-686a4af50a2a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Creating offline snapshot d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 of volume 8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0ff585-afdb-492b-90e8-84880e96cded]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:13 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:13 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:13 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28
Jul 23 03:34:13 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:13 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:13 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:13 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91
Jul 23 03:34:13 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:13 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 1G
Jul 23 03:34:13 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:14 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:14 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91
Jul 23 03:34:14 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:14 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 1G" returned: 0 in 0.430s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d297e37-9399-444f-a24c-222dc4ce4f28 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:14 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d297e37-9399-444f-a24c-222dc4ce4f28 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1
Jul 23 03:34:14 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:14 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78.f9487913-82e2-4a76-92fe-0d9525853c91" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-f9487913-82e2-4a76-92fe-0d9525853c91" released by "_delete_snapshot" :: held 1.471s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-871e3f00-c2a1-466b-9067-b18d94da4e78" released by "delete_snapshot" :: held 1.495s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Created reservations ['0a5e1ef8-0d9d-4c17-9e04-efb9cc952e08', 'dd85771e-8030-41d9-af15-c23fc3f8952f', 'a19d61ab-2707-40d9-a30f-57d042253b1b', '85e66faf-a62d-4fb0-acf2-fe7eb4043d10'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:14 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d297e37-9399-444f-a24c-222dc4ce4f28 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" returned: 0 in 0.308s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:14 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 is being set with open permissions: ugo+rw
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:14 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Delete snapshot completed successfully.
Jul 23 03:34:14 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1
Jul 23 03:34:14 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-a4586e98-2221-4a13-af58-1c356799ea1a tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-f9487913-82e2-4a76-92fe-0d9525853c91-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:14 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" returned: 0 in 0.239s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:14 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info
Jul 23 03:34:14 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:15 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:15 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info is being set with open permissions: ugo+rw
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:15 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info
Jul 23 03:34:15 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-871e3f00-c2a1-466b-9067-b18d94da4e78-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-871e3f00-c2a1-466b-9067-b18d94da4e78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-quobyte-871e3f00-c2a1-466b-9067-b18d94da4e78" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-871e3f00-c2a1-466b-9067-b18d94da4e78" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5c06a-838e-46f6-841d-87563e511815]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:15 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:15 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:15 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.info" returned: 0 in 0.275s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6912e971-05b9-420e-9161-fd386e17cafe tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-d61ed8ca-d6a8-4125-9443-2dc7af6cccf1-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Lock "cinder-d61ed8ca-d6a8-4125-9443-2dc7af6cccf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-8d297e37-9399-444f-a24c-222dc4ce4f28" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-8d297e37-9399-444f-a24c-222dc4ce4f28" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 of volume 8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[591fd96a-4bcc-483d-972a-3b39d86a2acf]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:15 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.401s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:15 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78
Jul 23 03:34:15 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:15 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1
Jul 23 03:34:15 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:15 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-871e3f00-c2a1-466b-9067-b18d94da4e78" returned: 0 in 0.242s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-871e3f00-c2a1-466b-9067-b18d94da4e78" released by "delete_volume" :: held 0.716s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Created reservations ['198dc464-c5d8-4c4b-b16f-5d438815240a', '58ad6bae-85c4-4f74-86b9-8e0ed230f4e0', '2e9f69e7-c713-4875-ac6d-9e77c8289312', 'efa1520c-04d6-419c-967b-1d15dfaed9e6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:15 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" returned: 0 in 0.386s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d297e37-9399-444f-a24c-222dc4ce4f28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c1920-0bfa-4613-8505-28ea91bd026e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:16 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:16 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:16 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28
Jul 23 03:34:16 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-78a048f1-fcd5-4eba-9a2f-761df2b5a244-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-78a048f1-fcd5-4eba-9a2f-761df2b5a244-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:16 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.294s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Deleted volume successfully.
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "cinder-quobyte-78a048f1-fcd5-4eba-9a2f-761df2b5a244" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-78a048f1-fcd5-4eba-9a2f-761df2b5a244" acquired by "delete_volume" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:16 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-8e8dcd62-f5bc-42fd-915c-ae648285e4cf tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-871e3f00-c2a1-466b-9067-b18d94da4e78-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28" returned: 0 in 0.412s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bbfe5d-1899-4a80-abe7-c67e305f4bd4]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:16 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1
Jul 23 03:34:16 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:16 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244
Jul 23 03:34:16 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:16 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:16 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1
Jul 23 03:34:16 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:16 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244" returned: 0 in 0.405s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:16 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244
Jul 23 03:34:16 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:16 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28.d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" returned: 0 in 0.254s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-d61ed8ca-d6a8-4125-9443-2dc7af6cccf1" released by "_delete_snapshot" :: held 1.487s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-8d297e37-9399-444f-a24c-222dc4ce4f28" released by "delete_snapshot" :: held 1.515s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Created reservations ['ae6e2bef-eff6-4bbb-9af6-ac18487ddb33', '7da97544-3105-4127-9b68-30e7a9aa6b9c', 'd57a86be-ba7c-4e93-b54b-a0ae339df647', '2ae42c06-5c73-42a8-920a-38aba704c8aa'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:17 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-78a048f1-fcd5-4eba-9a2f-761df2b5a244" returned: 0 in 0.271s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-quobyte-78a048f1-fcd5-4eba-9a2f-761df2b5a244" released by "delete_volume" :: held 0.724s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-ba73a9bb-4f54-4826-a8e1-3db9789b0f79 tempest-ProjectMemberTests-344425068 None] Lock "cinder-d61ed8ca-d6a8-4125-9443-2dc7af6cccf1-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Created reservations ['7af6f89b-bdc1-48aa-96d2-ce04add9e93f', '975c52f4-5147-4886-966c-a86dbc5d4ab3', '8a23f173-bac0-422f-8f03-754b80597bb7', 'ee3a4db3-30ea-42e2-b025-27e36b27ed02'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:17 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:17 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:17 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.279s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:17 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Deleted volume successfully.
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6f170480-eaf4-4789-9b0c-bedd773835d7 tempest-SnapshotDependencyTests-1057838581 None] Lock "cinder-78a048f1-fcd5-4eba-9a2f-761df2b5a244-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-8d297e37-9399-444f-a24c-222dc4ce4f28-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Lock "cinder-8d297e37-9399-444f-a24c-222dc4ce4f28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-8d297e37-9399-444f-a24c-222dc4ce4f28" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-8d297e37-9399-444f-a24c-222dc4ce4f28" acquired by "delete_volume" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[50552c64-d17e-4c9a-9ba8-a9ee549b8ab6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:17 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28
Jul 23 03:34:17 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:18 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28" returned: 0 in 0.388s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:18 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28
Jul 23 03:34:18 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:18 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-8d297e37-9399-444f-a24c-222dc4ce4f28" returned: 0 in 0.269s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-8d297e37-9399-444f-a24c-222dc4ce4f28" released by "delete_volume" :: held 0.722s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Created reservations ['cce97689-10dd-449f-9ec3-bb7be52b411c', '69a20b62-f332-4514-920d-b123c39bbf86', '9061f663-b607-4571-802f-020d5a581535', 'b4f90e14-c92e-4d0b-9186-ed855ccc39e6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:18 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:18 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:18 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.270s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-826b78d4-3d5c-469c-b657-b1f5dfdadad6 tempest-ProjectMemberTests-344425068 None] Lock "cinder-8d297e37-9399-444f-a24c-222dc4ce4f28-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (0a495290-c880-4825-ac23-bc2b7e61f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d1b090-3872-4d57-a2ee-386f3a15e28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d1b090-3872-4d57-a2ee-386f3a15e28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816967439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052025c2-6d39-49de-bb87-18843607e82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:19Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159ab593-61a5-4c6b-a6da-730b524dc665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159ab593-61a5-4c6b-a6da-730b524dc665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d27daa-bf8a-4a12-a9c6-2dbc730d7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d27daa-bf8a-4a12-a9c6-2dbc730d7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052025c2-6d39-49de-bb87-18843607e82d', 'volume_name': 'volume-052025c2-6d39-49de-bb87-18843607e82d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d9ec5d-61b5-42ac-85a2-ebffb1e14561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d9ec5d-61b5-42ac-85a2-ebffb1e14561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d7acaa-4fbb-4654-966f-7fba8a05a352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Volume 052025c2-6d39-49de-bb87-18843607e82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052025c2-6d39-49de-bb87-18843607e82d', 'volume_size': 1}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816967439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052025c2-6d39-49de-bb87-18843607e82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:19Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Creating volume 052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:19 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:19 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d 1073741824
Jul 23 03:34:19 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:19 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d 1073741824" returned: 0 in 0.429s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:19 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d
Jul 23 03:34:19 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:20 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d" returned: 0 in 0.249s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d7acaa-4fbb-4654-966f-7fba8a05a352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052025c2-6d39-49de-bb87-18843607e82d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcab8be-c0d2-49ce-92d4-45dc78439787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:20 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Volume volume-052025c2-6d39-49de-bb87-18843607e82d (052025c2-6d39-49de-bb87-18843607e82d): created successfully
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcab8be-c0d2-49ce-92d4-45dc78439787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (0a495290-c880-4825-ac23-bc2b7e61f956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:20 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-48a5592a-5327-496f-8292-0316063e5241 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Creating offline snapshot 3c014f93-36fb-4c6d-9194-aaab067d9141 of volume 052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb426b35-06df-4ac7-8c79-02f9f96b3e1a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:20 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d
Jul 23 03:34:20 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:21 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:21 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 1G
Jul 23 03:34:21 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:21 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 1G" returned: 0 in 0.465s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-052025c2-6d39-49de-bb87-18843607e82d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:21 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-052025c2-6d39-49de-bb87-18843607e82d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141
Jul 23 03:34:21 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:21 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-052025c2-6d39-49de-bb87-18843607e82d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141" returned: 0 in 0.289s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:21 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 is being set with open permissions: ugo+rw
Jul 23 03:34:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:21 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141
Jul 23 03:34:21 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:22 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:22 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info
Jul 23 03:34:22 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:22 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info" returned: 0 in 0.259s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:22 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info is being set with open permissions: ugo+rw
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:22 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info
Jul 23 03:34:22 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:22 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.info" returned: 0 in 0.247s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cb355759-3b53-42a2-83ca-78c5029dc226 tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-3c014f93-36fb-4c6d-9194-aaab067d9141-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Lock "cinder-3c014f93-36fb-4c6d-9194-aaab067d9141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-052025c2-6d39-49de-bb87-18843607e82d" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-052025c2-6d39-49de-bb87-18843607e82d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-3c014f93-36fb-4c6d-9194-aaab067d9141" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-3c014f93-36fb-4c6d-9194-aaab067d9141" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot 3c014f93-36fb-4c6d-9194-aaab067d9141 of volume 052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb98096-bd99-46e8-ae16-6c759015ebfd]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:22 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141
Jul 23 03:34:22 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:23 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141" returned: 0 in 0.364s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:23 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-052025c2-6d39-49de-bb87-18843607e82d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:23 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e036eae-6b14-487e-9b71-8956e215036c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:23 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d
Jul 23 03:34:23 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:23 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d" returned: 0 in 0.388s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:23 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141
Jul 23 03:34:23 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:24 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141" returned: 0 in 0.392s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:24 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141
Jul 23 03:34:24 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:24 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d.3c014f93-36fb-4c6d-9194-aaab067d9141" returned: 0 in 0.248s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-3c014f93-36fb-4c6d-9194-aaab067d9141" released by "_delete_snapshot" :: held 1.484s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-052025c2-6d39-49de-bb87-18843607e82d" released by "delete_snapshot" :: held 1.511s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Created reservations ['92cc6475-2141-4036-92cd-937eb044530f', '7c51c307-b5ac-4813-b820-3ca982bc9bed', 'fced4d52-be3b-45ba-87a4-d967979681f6', '83f32a7a-056c-4461-9bf4-a394a6a94c3b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:24 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-0a878d51-d647-4e62-9456-347fd45af960 tempest-ProjectMemberTests-344425068 None] Lock "cinder-3c014f93-36fb-4c6d-9194-aaab067d9141-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-052025c2-6d39-49de-bb87-18843607e82d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Lock "cinder-052025c2-6d39-49de-bb87-18843607e82d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-052025c2-6d39-49de-bb87-18843607e82d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-052025c2-6d39-49de-bb87-18843607e82d" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3657c5-5ba1-4ce1-b8f1-b7c859b7e896]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:25 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d
Jul 23 03:34:25 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:25 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d" returned: 0 in 0.351s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:25 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d
Jul 23 03:34:25 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:25 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-052025c2-6d39-49de-bb87-18843607e82d" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-052025c2-6d39-49de-bb87-18843607e82d" released by "delete_volume" :: held 0.668s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Created reservations ['04945c28-de4b-47a1-a983-b33b9b067457', '959a2c84-c601-4ab2-9ff3-abd12443e2f3', '36dffa82-bbc6-4b32-8120-208b88429af9', '03e5859b-8550-4646-88ca-4d360c3da996'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:25 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:25 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:26 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.274s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:26 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32f43f9a-cefe-41af-9e36-def425d2633f tempest-ProjectMemberTests-344425068 None] Lock "cinder-052025c2-6d39-49de-bb87-18843607e82d-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (af88e47f-9215-44b3-b1fd-c3a6e207f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a5a291-26d3-4e12-83de-94b63ac6bbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a5a291-26d3-4e12-83de-94b63ac6bbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391883933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b14bfc9-4227-4754-8168-61fc83f94a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:27Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78adbc76-6e9c-4ba0-a912-4ea2829e7025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78adbc76-6e9c-4ba0-a912-4ea2829e7025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85abd08-c379-4637-8c76-d64769c5e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85abd08-c379-4637-8c76-d64769c5e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b14bfc9-4227-4754-8168-61fc83f94a14', 'volume_name': 'volume-9b14bfc9-4227-4754-8168-61fc83f94a14', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793da5c2-cb28-4021-ab16-9d71e723b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793da5c2-cb28-4021-ab16-9d71e723b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f57fac-3cbc-4aa2-9589-e483490e4d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Volume 9b14bfc9-4227-4754-8168-61fc83f94a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b14bfc9-4227-4754-8168-61fc83f94a14', 'volume_size': 1}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391883933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b14bfc9-4227-4754-8168-61fc83f94a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:27Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Creating volume 9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:26 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:26 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 1073741824
Jul 23 03:34:26 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:27 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 1073741824" returned: 0 in 0.428s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:27 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14
Jul 23 03:34:27 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:27 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14" returned: 0 in 0.235s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f57fac-3cbc-4aa2-9589-e483490e4d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b14bfc9-4227-4754-8168-61fc83f94a14', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28935907-4d0a-4bb1-b326-2fabc6e04b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Volume volume-9b14bfc9-4227-4754-8168-61fc83f94a14 (9b14bfc9-4227-4754-8168-61fc83f94a14): created successfully
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28935907-4d0a-4bb1-b326-2fabc6e04b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (af88e47f-9215-44b3-b1fd-c3a6e207f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-982b4ce4-b106-4913-b690-1b022af783ec tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Creating offline snapshot 9ba46881-a567-490e-9ddf-b766738213ec of volume 9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc47f7ae-fb53-494b-a0c2-ac2fe057346e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:27 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14
Jul 23 03:34:27 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:28 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14" returned: 0 in 0.367s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:28 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec 1G
Jul 23 03:34:28 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:28 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec 1G" returned: 0 in 0.367s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14bfc9-4227-4754-8168-61fc83f94a14 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:28 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14bfc9-4227-4754-8168-61fc83f94a14 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec
Jul 23 03:34:28 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:28 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14bfc9-4227-4754-8168-61fc83f94a14 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec" returned: 0 in 0.288s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:28 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec is being set with open permissions: ugo+rw
Jul 23 03:34:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:28 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec
Jul 23 03:34:28 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:29 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec" returned: 0 in 0.236s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:29 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info
Jul 23 03:34:29 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:29 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info" returned: 0 in 0.251s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:29 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info is being set with open permissions: ugo+rw
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:29 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info
Jul 23 03:34:29 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:29 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.info" returned: 0 in 0.227s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:29 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cce2994b-0ed0-4ee0-8171-0a2a922834be tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-9ba46881-a567-490e-9ddf-b766738213ec-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Lock "cinder-9ba46881-a567-490e-9ddf-b766738213ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-9b14bfc9-4227-4754-8168-61fc83f94a14" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-9b14bfc9-4227-4754-8168-61fc83f94a14" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-9ba46881-a567-490e-9ddf-b766738213ec" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-9ba46881-a567-490e-9ddf-b766738213ec" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot 9ba46881-a567-490e-9ddf-b766738213ec of volume 9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a49d2-1598-46b7-aadb-0fc5e87ba961]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:30 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec
Jul 23 03:34:30 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:30 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:30 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14bfc9-4227-4754-8168-61fc83f94a14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:30 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b6d90-852a-494a-89dc-d5ee5f11581d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:30 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14
Jul 23 03:34:30 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:30 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:30 devstack sudo[107666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec
Jul 23 03:34:30 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:31 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec" returned: 0 in 0.333s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:31 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec
Jul 23 03:34:31 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:31 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14.9ba46881-a567-490e-9ddf-b766738213ec" returned: 0 in 0.239s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-9ba46881-a567-490e-9ddf-b766738213ec" released by "_delete_snapshot" :: held 1.346s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-9b14bfc9-4227-4754-8168-61fc83f94a14" released by "delete_snapshot" :: held 1.368s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:UPDATE=204,cinder:SELECT=133,cinder:DELETE=23,cinder:INSERT=45 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=164,cinder:INSERT=58,cinder:UPDATE=197,cinder:DELETE=12 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Created reservations ['8299c914-36e5-4a2a-9cd5-7167ac2eaf9c', '5d6d453e-c6c7-467c-a3f1-c60dca5a8d43', 'c9c289dd-1088-40fa-8e01-91e7d0894c9e', '732afdcd-3821-4542-a324-cdf82fdce39a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:31 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-32be5970-dbfe-482f-b15a-ebcc56fc18aa tempest-ProjectMemberTests-344425068 None] Lock "cinder-9ba46881-a567-490e-9ddf-b766738213ec-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-9b14bfc9-4227-4754-8168-61fc83f94a14-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Lock "cinder-9b14bfc9-4227-4754-8168-61fc83f94a14-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-9b14bfc9-4227-4754-8168-61fc83f94a14" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-9b14bfc9-4227-4754-8168-61fc83f94a14" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf64f86a-be27-4eb8-bac2-962ce19ebf46]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:32 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14
Jul 23 03:34:32 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:32 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:32 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14
Jul 23 03:34:32 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:32 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9b14bfc9-4227-4754-8168-61fc83f94a14" returned: 0 in 0.237s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-9b14bfc9-4227-4754-8168-61fc83f94a14" released by "delete_volume" :: held 0.639s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Created reservations ['f859b8cc-dbda-41b8-b429-5761214ab0e6', '38892dd3-8052-4223-8491-637edf64f8ca', 'efcb05b2-8d0f-4bc5-988b-6b09d0d0931e', '7d45a29b-3bc6-4bd0-8e29-5dc59716d90e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:32 devstack sudo[107682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:32 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:33 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.235s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:33 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-c7b1bd01-43e8-4d8e-82d7-ffb3fc1a4b30 tempest-ProjectMemberTests-344425068 None] Lock "cinder-9b14bfc9-4227-4754-8168-61fc83f94a14-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (cf37e774-f253-472f-a38d-71976979fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3afbb6a-00a7-4d52-9893-defb7c0b3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3afbb6a-00a7-4d52-9893-defb7c0b3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323249287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a41f901-311b-49e9-b21d-9fe48c42657a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:34Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bce7e9-e569-4d96-931c-84fc616b0509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bce7e9-e569-4d96-931c-84fc616b0509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2345511-a98e-44e2-a56c-d684c51b29fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2345511-a98e-44e2-a56c-d684c51b29fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a41f901-311b-49e9-b21d-9fe48c42657a', 'volume_name': 'volume-4a41f901-311b-49e9-b21d-9fe48c42657a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e15a3a-d351-415f-9f29-f813b0fbdac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e15a3a-d351-415f-9f29-f813b0fbdac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8b2930-9bff-4b02-b2b1-f2bb03f9fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:33 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Volume 4a41f901-311b-49e9-b21d-9fe48c42657a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a41f901-311b-49e9-b21d-9fe48c42657a', 'volume_size': 1}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323249287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a41f901-311b-49e9-b21d-9fe48c42657a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:34Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Creating volume 4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:33 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:33 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:33 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a 1073741824
Jul 23 03:34:33 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:34 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a 1073741824" returned: 0 in 0.409s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:34 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a
Jul 23 03:34:34 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:34 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a" returned: 0 in 0.259s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8b2930-9bff-4b02-b2b1-f2bb03f9fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a41f901-311b-49e9-b21d-9fe48c42657a', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12905d53-d6ca-4807-80e3-3956e461787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:34 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Volume volume-4a41f901-311b-49e9-b21d-9fe48c42657a (4a41f901-311b-49e9-b21d-9fe48c42657a): created successfully
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12905d53-d6ca-4807-80e3-3956e461787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (cf37e774-f253-472f-a38d-71976979fe41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:34 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-f7158b9d-acd3-4fbb-8f74-e902e596caa5 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Creating offline snapshot b16e657a-ae50-4e15-ae52-ba6aa1ce6297 of volume 4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0ade7-0f95-46fe-a4f4-67e7502b0894]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:34 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:34 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a
Jul 23 03:34:34 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:35 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:35 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 1G
Jul 23 03:34:35 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:35 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 1G" returned: 0 in 0.385s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a41f901-311b-49e9-b21d-9fe48c42657a -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:35 devstack sudo[107705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a41f901-311b-49e9-b21d-9fe48c42657a -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297
Jul 23 03:34:35 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:35 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a41f901-311b-49e9-b21d-9fe48c42657a -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297" returned: 0 in 0.298s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:35 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 is being set with open permissions: ugo+rw
Jul 23 03:34:35 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:35 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297
Jul 23 03:34:35 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:36 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:36 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info
Jul 23 03:34:36 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:36 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info" returned: 0 in 0.257s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:36 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info is being set with open permissions: ugo+rw
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:36 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info
Jul 23 03:34:36 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:36 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.info" returned: 0 in 0.257s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:36 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9c5f8234-79f8-4758-9155-1ca27e96c012 tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-b16e657a-ae50-4e15-ae52-ba6aa1ce6297-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Lock "cinder-b16e657a-ae50-4e15-ae52-ba6aa1ce6297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:36 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-4a41f901-311b-49e9-b21d-9fe48c42657a" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-4a41f901-311b-49e9-b21d-9fe48c42657a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-b16e657a-ae50-4e15-ae52-ba6aa1ce6297" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-b16e657a-ae50-4e15-ae52-ba6aa1ce6297" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot b16e657a-ae50-4e15-ae52-ba6aa1ce6297 of volume 4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689aed4-fc93-43ad-abbf-e2d17082c95a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:37 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297
Jul 23 03:34:37 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:37 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297" returned: 0 in 0.357s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a41f901-311b-49e9-b21d-9fe48c42657a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064de2a-5e48-4a99-8e3f-e4573aa205cc]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:37 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a
Jul 23 03:34:37 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:37 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:37 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:37 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297
Jul 23 03:34:37 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:38 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297" returned: 0 in 0.335s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:38 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297
Jul 23 03:34:38 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:38 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a.b16e657a-ae50-4e15-ae52-ba6aa1ce6297" returned: 0 in 0.226s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-b16e657a-ae50-4e15-ae52-ba6aa1ce6297" released by "_delete_snapshot" :: held 1.356s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-4a41f901-311b-49e9-b21d-9fe48c42657a" released by "delete_snapshot" :: held 1.375s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Created reservations ['d0d80c0f-c0e8-4185-8ebb-84d0a83cdec8', 'f1ff85e7-c8b1-4cfc-8679-436a3b7caba6', '45de6a5e-11dd-4779-a66b-70ea38bebb49', 'c49a09de-f20c-4428-817f-f7b4d3f6d6f4'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:38 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:38 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cd5a0add-7f0e-402a-ad33-a9c5db05ab28 tempest-ProjectMemberTests-344425068 None] Lock "cinder-b16e657a-ae50-4e15-ae52-ba6aa1ce6297-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-4a41f901-311b-49e9-b21d-9fe48c42657a-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-4a41f901-311b-49e9-b21d-9fe48c42657a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-4a41f901-311b-49e9-b21d-9fe48c42657a" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-4a41f901-311b-49e9-b21d-9fe48c42657a" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8de41f-d6c2-4d1a-9f4e-48be117cd4d6]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:39 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a
Jul 23 03:34:39 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:39 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a" returned: 0 in 0.327s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:39 devstack sudo[107778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a
Jul 23 03:34:39 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:39 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4a41f901-311b-49e9-b21d-9fe48c42657a" returned: 0 in 0.227s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-4a41f901-311b-49e9-b21d-9fe48c42657a" released by "delete_volume" :: held 0.612s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Created reservations ['83f83acd-20b2-424e-a9fb-b2794572bb85', 'd7c82d52-dd18-4201-b0b8-cd84b09075ea', 'cbfb0d4c-47d6-4cb3-97e7-782440644e56', '2addf6c4-feeb-49c7-acbf-9bc5b491ab84'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:39 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:39 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:39 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:40 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.236s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:40 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-3dbcb3fa-79a0-4e3e-9b99-181f519cdff1 tempest-ProjectMemberTests-344425068 None] Lock "cinder-4a41f901-311b-49e9-b21d-9fe48c42657a-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (6dc5d671-6028-4199-bf55-a520bdccf5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba7d1c9-36da-45a2-9fdf-2d91b3f50ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba7d1c9-36da-45a2-9fdf-2d91b3f50ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097983485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac8f9db-0eb5-4855-abeb-2022b3707ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:41Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692617ac-3f8a-4c9a-b5d4-ff11ae3600fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692617ac-3f8a-4c9a-b5d4-ff11ae3600fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec68ca2-3379-4c10-b93e-1ff4db36bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec68ca2-3379-4c10-b93e-1ff4db36bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac8f9db-0eb5-4855-abeb-2022b3707ea8', 'volume_name': 'volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a67ab7-9f05-4ea6-b221-b3c921106c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a67ab7-9f05-4ea6-b221-b3c921106c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d582305-f7ef-4c42-b5e0-5d1b1f58dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:40 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Volume cac8f9db-0eb5-4855-abeb-2022b3707ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8', 'volume_size': 1}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097983485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac8f9db-0eb5-4855-abeb-2022b3707ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:41Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Creating volume cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:40 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:40 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:40 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 1073741824
Jul 23 03:34:40 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:41 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 1073741824" returned: 0 in 0.413s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:41 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8
Jul 23 03:34:41 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:41 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8" returned: 0 in 0.228s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d582305-f7ef-4c42-b5e0-5d1b1f58dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0045e59-d9cb-4170-9fde-4989d79faff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:41 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Volume volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 (cac8f9db-0eb5-4855-abeb-2022b3707ea8): created successfully
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0045e59-d9cb-4170-9fde-4989d79faff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (6dc5d671-6028-4199-bf55-a520bdccf5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:41 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-861a0e95-e922-456e-a4bd-10f37bc62a64 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Creating offline snapshot 5c418190-cefc-448e-b0b5-90bcef88eefa of volume cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[283aeba6-f5cb-491f-9cc1-6c1883db3b5a]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:41 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:42 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8
Jul 23 03:34:42 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:42 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8" returned: 0 in 0.359s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:42 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa 1G
Jul 23 03:34:42 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:42 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa 1G" returned: 0 in 0.395s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:42 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa
Jul 23 03:34:42 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:42 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa" returned: 0 in 0.276s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:42 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa is being set with open permissions: ugo+rw
Jul 23 03:34:42 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:42 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa
Jul 23 03:34:42 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:43 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa" returned: 0 in 0.233s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:43 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info
Jul 23 03:34:43 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:43 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:43 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info is being set with open permissions: ugo+rw
Jul 23 03:34:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:43 devstack sudo[107815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info
Jul 23 03:34:43 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:43 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.info" returned: 0 in 0.255s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:43 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:43 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-bb40e920-a9c5-40f4-978d-647bc29a7139 tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-5c418190-cefc-448e-b0b5-90bcef88eefa-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Lock "cinder-5c418190-cefc-448e-b0b5-90bcef88eefa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-cac8f9db-0eb5-4855-abeb-2022b3707ea8" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-cac8f9db-0eb5-4855-abeb-2022b3707ea8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-5c418190-cefc-448e-b0b5-90bcef88eefa" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-5c418190-cefc-448e-b0b5-90bcef88eefa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot 5c418190-cefc-448e-b0b5-90bcef88eefa of volume cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2d5b9a-8066-4157-a633-d050798e4dbb]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:44 devstack sudo[107818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa
Jul 23 03:34:44 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:44 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[726955c7-e8a6-48ca-b891-42db279d3b52]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:44 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8
Jul 23 03:34:44 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:44 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8" returned: 0 in 0.349s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:44 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:44 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa
Jul 23 03:34:44 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:45 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa" returned: 0 in 0.338s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:45 devstack sudo[107834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa
Jul 23 03:34:45 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:45 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8.5c418190-cefc-448e-b0b5-90bcef88eefa" returned: 0 in 0.228s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-5c418190-cefc-448e-b0b5-90bcef88eefa" released by "_delete_snapshot" :: held 1.361s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-cac8f9db-0eb5-4855-abeb-2022b3707ea8" released by "delete_snapshot" :: held 1.386s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Created reservations ['bceb23cc-7034-450a-9c4e-e298debad02b', '47fc93d9-bdc7-4dfa-9ba7-087218d90a23', 'b6cf4445-42ea-4532-8d41-1c9cd367b410', '1803fcc7-08d3-4c5f-a4f7-96f26c3a99b8'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:45 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:45 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-97a58e40-7dbb-457c-918c-b74988a61909 tempest-ProjectMemberTests-344425068 None] Lock "cinder-5c418190-cefc-448e-b0b5-90bcef88eefa-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-cac8f9db-0eb5-4855-abeb-2022b3707ea8-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Lock "cinder-cac8f9db-0eb5-4855-abeb-2022b3707ea8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-cac8f9db-0eb5-4855-abeb-2022b3707ea8" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-cac8f9db-0eb5-4855-abeb-2022b3707ea8" acquired by "delete_volume" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef621de-ae6c-4e29-a820-26ef7ff3f289]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:46 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8
Jul 23 03:34:46 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:46 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8" returned: 0 in 0.330s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:46 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8
Jul 23 03:34:46 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:46 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-cac8f9db-0eb5-4855-abeb-2022b3707ea8" returned: 0 in 0.228s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-cac8f9db-0eb5-4855-abeb-2022b3707ea8" released by "delete_volume" :: held 0.609s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Created reservations ['7e86faac-e139-4ca8-90ed-e33726a700f3', '0809fb84-36ad-4144-9f25-adbe08ec307f', 'f5a34584-4375-4013-8a9a-874a7fee038b', 'd4ee811c-cbf1-428c-bfad-52e642e5eb45'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:46 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:47 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:47 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:47 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.232s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:47 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-7ce8637a-2376-4187-a051-e7e4c6d9cfd4 tempest-ProjectMemberTests-344425068 None] Lock "cinder-cac8f9db-0eb5-4855-abeb-2022b3707ea8-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (d4a0ba4d-110a-4fe0-b532-1f79a30a28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61006d8-00fd-410f-99dc-bd75a2c60934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61006d8-00fd-410f-99dc-bd75a2c60934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119112675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c75e2a-ff1a-44c4-aa2a-7e562998be1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:48Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e2043f-2383-4bb2-840a-661a0d46c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e2043f-2383-4bb2-840a-661a0d46c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401fa406-41bc-4d64-96c8-85833f8e6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401fa406-41bc-4d64-96c8-85833f8e6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c75e2a-ff1a-44c4-aa2a-7e562998be1c', 'volume_name': 'volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494aa40d-90db-4575-9e56-933324c8a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494aa40d-90db-4575-9e56-933324c8a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9bcb6d-ba5e-48d1-9b83-d731c7e471b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:47 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Volume 81c75e2a-ff1a-44c4-aa2a-7e562998be1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c', 'volume_size': 1}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119112675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c75e2a-ff1a-44c4-aa2a-7e562998be1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152752f05e264fee98835324d5aca88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:48Z,use_quota=True,user_id='3508f9b605b94f1da57032dac3ff7ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Creating volume 81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:47 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:47 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:47 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c 1073741824
Jul 23 03:34:47 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:48 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c 1073741824" returned: 0 in 0.397s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:48 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c
Jul 23 03:34:48 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:48 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" returned: 0 in 0.257s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9bcb6d-ba5e-48d1-9b83-d731c7e471b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cbe0b6-afe2-4b22-8801-115bdbcea03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:48 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Volume volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c (81c75e2a-ff1a-44c4-aa2a-7e562998be1c): created successfully
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5cbe0b6-afe2-4b22-8801-115bdbcea03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Flow 'volume_create_manager' (d4a0ba4d-110a-4fe0-b532-1f79a30a28c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:48 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-270c83b4-2d9b-42b2-a6a6-fec7edd5c954 tempest-ProjectMemberTests-344425068 None] Created volume successfully.
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Creating offline snapshot 6876838f-b518-4464-b830-625a96e3287c of volume 81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d5e33-4671-46f4-ab39-d195b5966613]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:48 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:49 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c
Jul 23 03:34:49 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:49 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:49 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c 1G
Jul 23 03:34:49 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:49 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c 1G" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:49 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c
Jul 23 03:34:49 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:49 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:49 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c is being set with open permissions: ugo+rw
Jul 23 03:34:49 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:49 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c
Jul 23 03:34:50 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:50 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c" returned: 0 in 0.233s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:50 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info
Jul 23 03:34:50 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:50 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info" returned: 0 in 0.252s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:50 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info is being set with open permissions: ugo+rw
Jul 23 03:34:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:50 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info
Jul 23 03:34:50 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:50 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.info" returned: 0 in 0.237s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:50 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:50 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-994e994b-0154-469a-b0fa-fb3e79cf0fca tempest-ProjectMemberTests-344425068 None] Create snapshot completed successfully
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-6876838f-b518-4464-b830-625a96e3287c-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Lock "cinder-6876838f-b518-4464-b830-625a96e3287c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-6876838f-b518-4464-b830-625a96e3287c" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-6876838f-b518-4464-b830-625a96e3287c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Deleting offline snapshot 6876838f-b518-4464-b830-625a96e3287c of volume 81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] snapshot_file for this snap is: volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b6fbd6-e5ff-42de-941d-2b12fd5cd70c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:51 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c
Jul 23 03:34:51 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:51 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b0f2a4-33c7-486f-a7a5-359c0eeb3dae]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:51 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:51 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c
Jul 23 03:34:51 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:52 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" returned: 0 in 0.391s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:52 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c
Jul 23 03:34:52 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:52 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c" returned: 0 in 0.326s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:52 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c
Jul 23 03:34:52 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:52 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c.6876838f-b518-4464-b830-625a96e3287c" returned: 0 in 0.254s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-6876838f-b518-4464-b830-625a96e3287c" released by "_delete_snapshot" :: held 1.412s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" released by "delete_snapshot" :: held 1.433s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Created reservations ['0bdf15d6-833f-4f2f-b7ca-8bc1921b011f', '74149ac2-cb8d-4295-9e30-26cb7eb99ef3', '1532e67d-9f1f-4d72-ade0-606757967e95', '07ed1d78-e587-4e12-8b83-40242c874416'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:52 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Delete snapshot completed successfully.
Jul 23 03:34:52 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-fb55893b-b3b5-40ed-b4fe-343eaa46047d tempest-ProjectMemberTests-344425068 None] Lock "cinder-6876838f-b518-4464-b830-625a96e3287c-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-81c75e2a-ff1a-44c4-aa2a-7e562998be1c-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Lock "cinder-81c75e2a-ff1a-44c4-aa2a-7e562998be1c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Acquiring lock "cinder-quobyte-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6eaab4-da4d-4773-a0c4-0248a78f8b70]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:53 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c
Jul 23 03:34:53 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:53 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" returned: 0 in 0.355s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:53 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:53 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c
Jul 23 03:34:53 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:54 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Lock "cinder-quobyte-81c75e2a-ff1a-44c4-aa2a-7e562998be1c" released by "delete_volume" :: held 0.656s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Created reservations ['0a3c1549-fed8-43f2-aff0-1680c3c389a5', 'aba7c1d2-337a-4b13-808e-6ff2338d4f37', 'b5d22ebe-9cef-4c03-92e2-56e80882492a', 'c251110e-22dd-4e43-90ac-a6cd2c47af19'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:54 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:54 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:54 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.230s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:54 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Deleted volume successfully.
Jul 23 03:34:54 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-edc5f067-09f5-4034-b348-108f45d700bc tempest-ProjectMemberTests-344425068 None] Lock "cinder-81c75e2a-ff1a-44c4-aa2a-7e562998be1c-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (7187279d-3a1f-4de1-9197-1f602ebe33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b682a7e9-bf1d-4816-b945-460612789f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b682a7e9-bf1d-4816-b945-460612789f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713121667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d1b022-fca7-4f9f-b38e-6f01341af622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:58Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a14a97-8753-42fc-9375-f263736c5fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a14a97-8753-42fc-9375-f263736c5fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d775907-9323-40ed-883d-3e4c665bb4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d775907-9323-40ed-883d-3e4c665bb4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d1b022-fca7-4f9f-b38e-6f01341af622', 'volume_name': 'volume-a4d1b022-fca7-4f9f-b38e-6f01341af622', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5bec67-c958-4ca8-b982-0c0e05cc2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5bec67-c958-4ca8-b982-0c0e05cc2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:57 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176516b5-51e8-4be9-9c99-d05b761bb5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Volume a4d1b022-fca7-4f9f-b38e-6f01341af622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d1b022-fca7-4f9f-b38e-6f01341af622', 'volume_size': 1}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713121667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d1b022-fca7-4f9f-b38e-6f01341af622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:58Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Creating volume a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:34:58 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:58 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 1073741824
Jul 23 03:34:58 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:58 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 1073741824" returned: 0 in 0.381s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:58 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622
Jul 23 03:34:58 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:58 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622" returned: 0 in 0.241s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176516b5-51e8-4be9-9c99-d05b761bb5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d1b022-fca7-4f9f-b38e-6f01341af622', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eec6f51-4fe1-4e33-9cf6-120d97923041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:34:58 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Volume volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 (a4d1b022-fca7-4f9f-b38e-6f01341af622): created successfully
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eec6f51-4fe1-4e33-9cf6-120d97923041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (7187279d-3a1f-4de1-9197-1f602ebe33a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:34:58 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-036f030a-1e87-45d0-a7c3-c6936c15af67 tempest-ProjectReaderTests-2012163941 None] Created volume successfully.
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:34:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:58 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:34:58 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:59 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.264s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Creating offline snapshot 105a2994-dbb9-4e7b-97ec-4be8d3902a90 of volume a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60eef4c-111f-4654-9afd-59f6e300dd7c]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:59 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622
Jul 23 03:34:59 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:59 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622" returned: 0 in 0.337s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:59 devstack sudo[107937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 1G
Jul 23 03:34:59 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:34:59 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 1G" returned: 0 in 0.362s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:34:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:34:59 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90
Jul 23 03:34:59 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:00 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90" returned: 0 in 0.268s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:00 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 is being set with open permissions: ugo+rw
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:00 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90
Jul 23 03:35:00 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:00 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90" returned: 0 in 0.233s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:00 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info
Jul 23 03:35:00 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:00 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info" returned: 0 in 0.241s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:00 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info is being set with open permissions: ugo+rw
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:00 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info
Jul 23 03:35:00 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:00 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.info" returned: 0 in 0.232s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:00 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.744s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:00 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9ba8d4ae-2a6b-4eee-96ef-2b679c56be5e tempest-ProjectReaderTests-2012163941 None] Create snapshot completed successfully
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-105a2994-dbb9-4e7b-97ec-4be8d3902a90-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Lock "cinder-105a2994-dbb9-4e7b-97ec-4be8d3902a90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-a4d1b022-fca7-4f9f-b38e-6f01341af622" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-a4d1b022-fca7-4f9f-b38e-6f01341af622" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-105a2994-dbb9-4e7b-97ec-4be8d3902a90" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-105a2994-dbb9-4e7b-97ec-4be8d3902a90" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Deleting offline snapshot 105a2994-dbb9-4e7b-97ec-4be8d3902a90 of volume a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] snapshot_file for this snap is: volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff39d6c0-c2aa-476e-b550-e52b5d14f8b8]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:01 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90
Jul 23 03:35:01 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:01 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90" returned: 0 in 0.341s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d1b022-fca7-4f9f-b38e-6f01341af622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f469d04-8750-4301-9ddb-a3ee62ed968b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:01 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:01 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622
Jul 23 03:35:01 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:02 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622" returned: 0 in 0.341s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:02 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90
Jul 23 03:35:02 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:02 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90" returned: 0 in 0.374s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:02 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90
Jul 23 03:35:02 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:02 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622.105a2994-dbb9-4e7b-97ec-4be8d3902a90" returned: 0 in 0.238s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-105a2994-dbb9-4e7b-97ec-4be8d3902a90" released by "_delete_snapshot" :: held 1.383s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-a4d1b022-fca7-4f9f-b38e-6f01341af622" released by "delete_snapshot" :: held 1.406s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Created reservations ['d4bc620b-483b-4527-bf43-58d363a5586a', 'c7a92709-82b4-4082-a3c4-824cc75ad710', 'c5db2482-bdd4-459c-9251-522e8f6a1ebf', '25f2d20a-85ad-4760-91f7-19466223a19e'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:02 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Delete snapshot completed successfully.
Jul 23 03:35:02 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cbb28793-216d-4123-80df-dcc3a0be261a tempest-ProjectReaderTests-2012163941 None] Lock "cinder-105a2994-dbb9-4e7b-97ec-4be8d3902a90-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-a4d1b022-fca7-4f9f-b38e-6f01341af622-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-a4d1b022-fca7-4f9f-b38e-6f01341af622-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-a4d1b022-fca7-4f9f-b38e-6f01341af622" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-a4d1b022-fca7-4f9f-b38e-6f01341af622" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[275debed-a42c-4a3d-8225-8a7d13ace4fd]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:03 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622
Jul 23 03:35:03 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:03 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622" returned: 0 in 0.343s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:03 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:03 devstack sudo[107984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622
Jul 23 03:35:03 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:04 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-a4d1b022-fca7-4f9f-b38e-6f01341af622" returned: 0 in 0.229s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-a4d1b022-fca7-4f9f-b38e-6f01341af622" released by "delete_volume" :: held 0.623s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Created reservations ['9bea835b-bbae-40c2-944b-36abb1ea34f6', '8dbf544e-b8b5-4077-a03f-0524f7b7ff60', 'b63013c2-17f9-4be6-8c27-bfadd6e3bfda', 'f90c1850-2805-45aa-87ca-b3a8d75437c5'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:04 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:35:04 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:04 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.229s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:35:04 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Deleted volume successfully.
Jul 23 03:35:04 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-666777f6-ada2-416b-8a8e-3969729e10b2 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-a4d1b022-fca7-4f9f-b38e-6f01341af622-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (5e1f2a0a-f71a-42f2-8fd6-259b82c04d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1e9fb8-9bf9-447c-9c7d-67f624b46e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1e9fb8-9bf9-447c-9c7d-67f624b46e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931292623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:05Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c010fc-f83e-4c26-a49b-f576df33f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c010fc-f83e-4c26-a49b-f576df33f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e614d7d-3217-4c53-9675-1882f781992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e614d7d-3217-4c53-9675-1882f781992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d', 'volume_name': 'volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e601ffc-ad7b-4feb-8bea-bd8d6347ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e601ffc-ad7b-4feb-8bea-bd8d6347ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e55de62-37bb-4ac6-a2f3-d256adb7d2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:05 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Volume 9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d', 'volume_size': 1}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931292623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:05Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Creating volume 9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:35:05 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:05 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d 1073741824
Jul 23 03:35:05 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:05 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d 1073741824" returned: 0 in 0.387s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:05 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d
Jul 23 03:35:05 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:05 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" returned: 0 in 0.225s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] <== create_volume: return (651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e55de62-37bb-4ac6-a2f3-d256adb7d2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4338de5-9182-4f8f-b7c5-88955dc5d2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:05 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Volume volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d (9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d): created successfully
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4338de5-9182-4f8f-b7c5-88955dc5d2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:05 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (5e1f2a0a-f71a-42f2-8fd6-259b82c04d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:05 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-d7eff649-804d-4e9e-8816-6cf9630a11c1 tempest-ProjectReaderTests-2012163941 None] Created volume successfully.
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Creating offline snapshot 247e5436-4cb7-4e68-a086-1fbeb603fa46 of volume 9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3599f072-db68-4675-9876-41850a7165af]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:06 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d
Jul 23 03:35:06 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:06 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" returned: 0 in 0.331s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:06 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 1G
Jul 23 03:35:06 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:06 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 1G" returned: 0 in 0.358s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:06 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:06 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46
Jul 23 03:35:06 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:07 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46" returned: 0 in 0.265s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:07 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 is being set with open permissions: ugo+rw
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:07 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46
Jul 23 03:35:07 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:07 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46" returned: 0 in 0.238s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:07 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info
Jul 23 03:35:07 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:07 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info" returned: 0 in 0.235s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:07 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info is being set with open permissions: ugo+rw
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:07 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info
Jul 23 03:35:07 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:07 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.info" returned: 0 in 0.222s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:07 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.722s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:07 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-a5907001-98e8-4deb-82c1-dbfec9bbfcb1 tempest-ProjectReaderTests-2012163941 None] Create snapshot completed successfully
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-247e5436-4cb7-4e68-a086-1fbeb603fa46-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-247e5436-4cb7-4e68-a086-1fbeb603fa46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-247e5436-4cb7-4e68-a086-1fbeb603fa46" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-247e5436-4cb7-4e68-a086-1fbeb603fa46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Deleting offline snapshot 247e5436-4cb7-4e68-a086-1fbeb603fa46 of volume 9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] snapshot_file for this snap is: volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a62b32-aa3d-4bec-8ea7-b77f9f3e6be5]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:08 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46
Jul 23 03:35:08 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:08 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46" returned: 0 in 0.330s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b9e12-8247-4619-ab50-59c10ee0577e]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:08 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:08 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d
Jul 23 03:35:08 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:09 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:09 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46
Jul 23 03:35:09 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:09 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46" returned: 0 in 0.346s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:09 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46
Jul 23 03:35:09 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:09 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d.247e5436-4cb7-4e68-a086-1fbeb603fa46" returned: 0 in 0.227s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-247e5436-4cb7-4e68-a086-1fbeb603fa46" released by "_delete_snapshot" :: held 1.331s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" released by "delete_snapshot" :: held 1.350s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Created reservations ['169a347d-c892-49da-9752-fe2a2c5c3066', '34365979-48c8-442e-9169-4b434197bf46', 'ab0764bb-41ba-42d3-93e3-a8d0591ff24b', '76419a18-8e7c-4a64-8a08-9581b060278a'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:09 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Delete snapshot completed successfully.
Jul 23 03:35:09 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-6e0d40ad-db28-4640-b360-cef6ab30e7f6 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-247e5436-4cb7-4e68-a086-1fbeb603fa46-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e3340e-e28e-4cb7-bd6d-1b3b6fe671e0]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:10 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d
Jul 23 03:35:10 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:10 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" returned: 0 in 0.336s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:10 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:10 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d
Jul 23 03:35:10 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:11 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" returned: 0 in 0.236s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d" released by "delete_volume" :: held 0.626s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Created reservations ['83927988-cec0-4e65-95bc-bbbf716bffc1', 'b0c93139-de4d-4f96-920f-361aafef769b', '4976a77d-a3db-4922-a6de-b43f51d665fa', 'd0270736-8782-4df1-8779-d06175b518a6'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:11 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:35:11 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:11 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.271s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:35:11 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Deleted volume successfully.
Jul 23 03:35:11 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-cc684f17-4452-4183-84f9-1a4cbf8b5f92 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-9dc9fbc5-0563-411f-9e48-a1ffe8cbf86d-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (98b6a56b-18c3-41b7-9de7-5c4c93368c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db8dae5-7c1c-4f85-9388-60b0d89da76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db8dae5-7c1c-4f85-9388-60b0d89da76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986947170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb94bc-2b68-4931-88ae-0d30c846b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:12Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8764634d-a090-4eaa-82ec-292adb64b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8764634d-a090-4eaa-82ec-292adb64b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7187ea8-c34e-43ef-9bb4-a88d994471f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7187ea8-c34e-43ef-9bb4-a88d994471f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cb94bc-2b68-4931-88ae-0d30c846b12b', 'volume_name': 'volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e5d57b-15ee-4f2e-9f4f-a4e0f8c62044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e5d57b-15ee-4f2e-9f4f-a4e0f8c62044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07eb231b-b7d3-4854-b467-cc05aecd198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Volume e9cb94bc-2b68-4931-88ae-0d30c846b12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b', 'volume_size': 1}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986947170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb94bc-2b68-4931-88ae-0d30c846b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:12Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Creating volume e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:35:12 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:12 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b 1073741824
Jul 23 03:35:12 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:12 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b 1073741824" returned: 0 in 0.417s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:12 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b
Jul 23 03:35:12 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:12 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b" returned: 0 in 0.243s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07eb231b-b7d3-4854-b467-cc05aecd198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7351cdd-7cab-484b-8ab9-4269f1881d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:12 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Volume volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b (e9cb94bc-2b68-4931-88ae-0d30c846b12b): created successfully
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7351cdd-7cab-484b-8ab9-4269f1881d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:12 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (98b6a56b-18c3-41b7-9de7-5c4c93368c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:12 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9a690330-83af-40b1-a90f-590451997d53 tempest-ProjectReaderTests-2012163941 None] Created volume successfully.
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Creating offline snapshot 1f9102a2-6f87-420d-86c3-f151859ef3c7 of volume e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[41297781-d714-49f9-b08b-69e910397277]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:13 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b
Jul 23 03:35:13 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:13 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b" returned: 0 in 0.354s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:13 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 1G
Jul 23 03:35:13 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:13 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 1G" returned: 0 in 0.393s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:13 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:13 devstack sudo[108075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7
Jul 23 03:35:13 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:14 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7" returned: 0 in 0.284s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:14 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 is being set with open permissions: ugo+rw
Jul 23 03:35:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:14 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7
Jul 23 03:35:14 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:14 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7" returned: 0 in 0.228s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:14 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info
Jul 23 03:35:14 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:14 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info" returned: 0 in 0.247s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:14 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info is being set with open permissions: ugo+rw
Jul 23 03:35:14 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:14 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info
Jul 23 03:35:14 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:15 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.info" returned: 0 in 0.249s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:15 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-57854b09-4a95-41b3-bf04-346229d9e085 tempest-ProjectReaderTests-2012163941 None] Create snapshot completed successfully
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-1f9102a2-6f87-420d-86c3-f151859ef3c7-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-1f9102a2-6f87-420d-86c3-f151859ef3c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-e9cb94bc-2b68-4931-88ae-0d30c846b12b" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-e9cb94bc-2b68-4931-88ae-0d30c846b12b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-1f9102a2-6f87-420d-86c3-f151859ef3c7" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-1f9102a2-6f87-420d-86c3-f151859ef3c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Deleting offline snapshot 1f9102a2-6f87-420d-86c3-f151859ef3c7 of volume e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] snapshot_file for this snap is: volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558430c-5819-4887-a8cf-1dcc9a856259]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:15 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7
Jul 23 03:35:15 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:15 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7" returned: 0 in 0.363s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[995dfdfc-8e54-41ec-8dae-c050bc245e99]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:15 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:15 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b
Jul 23 03:35:15 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:16 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b" returned: 0 in 0.365s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:16 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7
Jul 23 03:35:16 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:16 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7" returned: 0 in 0.340s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:16 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7
Jul 23 03:35:16 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:16 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b.1f9102a2-6f87-420d-86c3-f151859ef3c7" returned: 0 in 0.255s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-1f9102a2-6f87-420d-86c3-f151859ef3c7" released by "_delete_snapshot" :: held 1.409s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-e9cb94bc-2b68-4931-88ae-0d30c846b12b" released by "delete_snapshot" :: held 1.434s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Created reservations ['3132de58-55b8-4396-910f-f5c8c8a08ea8', 'c9685e48-2b27-4bb9-9274-0703d7c8a569', '846a8011-bd26-40ae-a13e-33a51435152e', '2e9a1a20-3dee-4c1a-af2f-5ad4c06d92fe'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:16 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Delete snapshot completed successfully.
Jul 23 03:35:16 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-b55b8dd5-628e-41ba-b7cd-bfa35493855f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-1f9102a2-6f87-420d-86c3-f151859ef3c7-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-e9cb94bc-2b68-4931-88ae-0d30c846b12b-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-e9cb94bc-2b68-4931-88ae-0d30c846b12b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-e9cb94bc-2b68-4931-88ae-0d30c846b12b" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-e9cb94bc-2b68-4931-88ae-0d30c846b12b" acquired by "delete_volume" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d012d1-f647-41f9-8c81-51fb139c717d]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:17 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b
Jul 23 03:35:17 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:17 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:17 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:17 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b
Jul 23 03:35:17 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:18 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-e9cb94bc-2b68-4931-88ae-0d30c846b12b" returned: 0 in 0.259s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-e9cb94bc-2b68-4931-88ae-0d30c846b12b" released by "delete_volume" :: held 0.655s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Created reservations ['31168cf7-cc62-419c-8f67-9d4620d25c5f', '705bb9c6-a753-4a40-9fae-31d6986d094d', 'ad73fde1-4c15-40f8-a6cc-b5b31daaddf0', '9f8c688a-4903-449d-b90c-47cb90d355f8'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:18 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:35:18 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:18 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:35:18 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Deleted volume successfully.
Jul 23 03:35:18 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-e8cf6389-784d-44de-b9b6-8dee00e83cc4 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-e9cb94bc-2b68-4931-88ae-0d30c846b12b-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (ca677204-697c-48ce-9445-039341fa6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf23b39-3a95-4da9-8c0f-8cd9cfd8d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf23b39-3a95-4da9-8c0f-8cd9cfd8d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817467976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2304e8-df61-43e6-930e-ed7a4032fb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:19Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ae3d9-3644-44f7-a6b9-28d0886879aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ae3d9-3644-44f7-a6b9-28d0886879aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8ea813-14bc-4210-be85-dd4d89b70ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8ea813-14bc-4210-be85-dd4d89b70ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd2304e8-df61-43e6-930e-ed7a4032fb58', 'volume_name': 'volume-bd2304e8-df61-43e6-930e-ed7a4032fb58', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18226ea6-fea9-4b4a-9fa7-bae1c2ba77a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18226ea6-fea9-4b4a-9fa7-bae1c2ba77a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bc3205-8a85-40b3-a00a-3e0430a52a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Volume bd2304e8-df61-43e6-930e-ed7a4032fb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd2304e8-df61-43e6-930e-ed7a4032fb58', 'volume_size': 1}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817467976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2304e8-df61-43e6-930e-ed7a4032fb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:19Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Creating volume bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:35:19 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:19 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 1073741824
Jul 23 03:35:19 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:19 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 1073741824" returned: 0 in 0.436s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:19 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58
Jul 23 03:35:19 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:19 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58" returned: 0 in 0.244s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bc3205-8a85-40b3-a00a-3e0430a52a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd2304e8-df61-43e6-930e-ed7a4032fb58', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a28965-7acb-49ce-9e72-1d4107a4481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:19 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Volume volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 (bd2304e8-df61-43e6-930e-ed7a4032fb58): created successfully
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a28965-7acb-49ce-9e72-1d4107a4481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:19 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (ca677204-697c-48ce-9445-039341fa6925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:19 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-ce8038e5-c194-41bf-ad25-1bd39c3040e7 tempest-ProjectReaderTests-2012163941 None] Created volume successfully.
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Creating offline snapshot 85a50940-cfe2-42bf-a1d4-7c220dd69ef5 of volume bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[588175b2-8c6e-4205-9634-60787b2bf521]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:20 devstack sudo[108131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58
Jul 23 03:35:20 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:20 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58" returned: 0 in 0.369s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:20 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:20 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 1G
Jul 23 03:35:20 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:21 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 1G" returned: 0 in 0.384s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:21 devstack sudo[108142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5
Jul 23 03:35:21 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:21 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5" returned: 0 in 0.282s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:21 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 is being set with open permissions: ugo+rw
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:21 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5
Jul 23 03:35:21 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:21 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5" returned: 0 in 0.232s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:21 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info
Jul 23 03:35:21 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:21 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info" returned: 0 in 0.246s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:21 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info is being set with open permissions: ugo+rw
Jul 23 03:35:21 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:21 devstack sudo[108153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info
Jul 23 03:35:21 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:22 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.info" returned: 0 in 0.254s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:22 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-2c2a7611-a872-4b50-8b78-44edb700900e tempest-ProjectReaderTests-2012163941 None] Create snapshot completed successfully
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-85a50940-cfe2-42bf-a1d4-7c220dd69ef5-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-85a50940-cfe2-42bf-a1d4-7c220dd69ef5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-bd2304e8-df61-43e6-930e-ed7a4032fb58" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-bd2304e8-df61-43e6-930e-ed7a4032fb58" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-85a50940-cfe2-42bf-a1d4-7c220dd69ef5" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-85a50940-cfe2-42bf-a1d4-7c220dd69ef5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Deleting offline snapshot 85a50940-cfe2-42bf-a1d4-7c220dd69ef5 of volume bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] snapshot_file for this snap is: volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a1bdfc-47a0-4d2d-a10d-5106011f9314]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:22 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5
Jul 23 03:35:22 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:22 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5" returned: 0 in 0.335s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd2304e8-df61-43e6-930e-ed7a4032fb58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[d592e402-ac12-4d7e-b1fb-38ec98da5085]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:22 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:22 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58
Jul 23 03:35:22 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:23 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58" returned: 0 in 0.347s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:23 devstack sudo[108166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5
Jul 23 03:35:23 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:23 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5" returned: 0 in 0.338s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:23 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5
Jul 23 03:35:23 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:23 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58.85a50940-cfe2-42bf-a1d4-7c220dd69ef5" returned: 0 in 0.232s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-85a50940-cfe2-42bf-a1d4-7c220dd69ef5" released by "_delete_snapshot" :: held 1.336s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-bd2304e8-df61-43e6-930e-ed7a4032fb58" released by "delete_snapshot" :: held 1.357s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Created reservations ['7e4bf22b-d1c9-42ea-bc70-ae02504a0680', '5773b16a-ea23-4841-af22-b7debf4b4289', '2a015f72-44b0-4efc-87dc-0049654b8fc3', '469fe18e-f2b5-4cd8-af70-3f84e93d7828'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:23 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Delete snapshot completed successfully.
Jul 23 03:35:23 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-464074ff-af40-4e47-916e-69cc404a7e0f tempest-ProjectReaderTests-2012163941 None] Lock "cinder-85a50940-cfe2-42bf-a1d4-7c220dd69ef5-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-bd2304e8-df61-43e6-930e-ed7a4032fb58-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-bd2304e8-df61-43e6-930e-ed7a4032fb58-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-bd2304e8-df61-43e6-930e-ed7a4032fb58" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:24 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-bd2304e8-df61-43e6-930e-ed7a4032fb58" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:24 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0101e0-1aa9-45de-bd89-2c28cc6660d1]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:24 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:24 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58
Jul 23 03:35:24 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:25 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58" returned: 0 in 0.376s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:25 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58
Jul 23 03:35:25 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:25 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-bd2304e8-df61-43e6-930e-ed7a4032fb58" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-bd2304e8-df61-43e6-930e-ed7a4032fb58" released by "delete_volume" :: held 0.674s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Created reservations ['c7cce257-a931-409e-b540-0e452b36e926', '64d92dd6-f223-4beb-9699-c4df2ae977f4', 'f94b16d1-75f1-4d73-8b76-afb9ce165ac8', '48726dae-96d4-456c-9079-e211282a9118'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:25 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:35:25 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:25 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.249s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:35:25 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Deleted volume successfully.
Jul 23 03:35:25 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-4e489196-640f-40d1-9ca2-657e206e37d3 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-bd2304e8-df61-43e6-930e-ed7a4032fb58-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88344) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (f8bf4c33-479c-455e-b2f6-62ddd8a96d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8594d0f6-9cdf-40d7-b0a9-1a68552a3947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8594d0f6-9cdf-40d7-b0a9-1a68552a3947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24400736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb53154-ac50-4352-a065-32b2cf53ef05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:26Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0970fff-f342-491e-8dc4-4944726d2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0970fff-f342-491e-8dc4-4944726d2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d43939d-3298-4a28-9d58-92a3288a2394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d43939d-3298-4a28-9d58-92a3288a2394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb53154-ac50-4352-a065-32b2cf53ef05', 'volume_name': 'volume-4eb53154-ac50-4352-a065-32b2cf53ef05', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4835f927-7794-47e6-99ff-23537d9459a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4835f927-7794-47e6-99ff-23537d9459a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c869e195-6999-4696-976f-9926ce6081a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:26 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Volume 4eb53154-ac50-4352-a065-32b2cf53ef05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb53154-ac50-4352-a065-32b2cf53ef05', 'volume_size': 1}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73694049b440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-23T01:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24400736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb53154-ac50-4352-a065-32b2cf53ef05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d854d843a7142b4a820bb6127ed4489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:26Z,use_quota=True,user_id='a573fa1bc7144e9493bc18002bf593b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050139e-dfe7-41e2-8318-1ccb6c7984a1),volume_type_id=f050139e-dfe7-41e2-8318-1ccb6c7984a1)}" {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Creating volume 4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Selected osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236 as target Quobyte volume. {{(pid=88344) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 23 03:35:26 devstack cinder-volume[88344]: INFO cinder.volume.drivers.remotefs [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] casted to osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 1073741824 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:26 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 1073741824
Jul 23 03:35:26 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:26 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 1073741824" returned: 0 in 0.407s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:26 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05
Jul 23 03:35:26 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:26 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05" returned: 0 in 0.241s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'} {{(pid=88344) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c869e195-6999-4696-976f-9926ce6081a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb53154-ac50-4352-a065-32b2cf53ef05', 'volume_size': 1}' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:26 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60e85ba-175b-4bd9-a0e7-049524b05d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 23 03:35:27 devstack cinder-volume[88344]: INFO cinder.volume.flows.manager.create_volume [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Volume volume-4eb53154-ac50-4352-a065-32b2cf53ef05 (4eb53154-ac50-4352-a065-32b2cf53ef05): created successfully
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60e85ba-175b-4bd9-a0e7-049524b05d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88344) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Flow 'volume_create_manager' (f8bf4c33-479c-455e-b2f6-62ddd8a96d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88344) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 23 03:35:27 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-9ed6baa8-5334-422f-b21e-1e97fb7cf562 tempest-ProjectReaderTests-2012163941 None] Created volume successfully.
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Creating offline snapshot 26a0f46c-c28b-4df3-af53-61a1f909fd8e of volume 4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1821}}
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221473a-46d3-44cd-b264-218a2167ff0b]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:27 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05
Jul 23 03:35:27 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:27 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05" returned: 0 in 0.335s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:27 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e 1G {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:27 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e 1G
Jul 23 03:35:27 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:28 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e 1G" returned: 0 in 0.404s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb53154-ac50-4352-a065-32b2cf53ef05 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:28 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb53154-ac50-4352-a065-32b2cf53ef05 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e
Jul 23 03:35:28 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:28 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb53154-ac50-4352-a065-32b2cf53ef05 -F qcow2 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e" returned: 0 in 0.275s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:28 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e is being set with open permissions: ugo+rw
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:28 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e
Jul 23 03:35:28 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:28 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e" returned: 0 in 0.227s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:28 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info
Jul 23 03:35:28 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:28 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:28 devstack cinder-volume[88344]: WARNING cinder.volume.drivers.remotefs [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info is being set with open permissions: ugo+rw
Jul 23 03:35:28 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:28 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info
Jul 23 03:35:28 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:29 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.info" returned: 0 in 0.253s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:29 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-4114eaa8-04d2-4802-bee5-6f0d892c7786 tempest-ProjectReaderTests-2012163941 None] Create snapshot completed successfully
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-26a0f46c-c28b-4df3-af53-61a1f909fd8e-delete_snapshot" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-26a0f46c-c28b-4df3-af53-61a1f909fd8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-4eb53154-ac50-4352-a065-32b2cf53ef05" by "delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-4eb53154-ac50-4352-a065-32b2cf53ef05" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-26a0f46c-c28b-4df3-af53-61a1f909fd8e" by "_delete_snapshot" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-26a0f46c-c28b-4df3-af53-61a1f909fd8e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Deleting offline snapshot 26a0f46c-c28b-4df3-af53-61a1f909fd8e of volume 4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] snapshot_file for this snap is: volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e {{(pid=88344) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[643f4349-beaf-4938-bc01-1bee4b23bc71]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:29 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e
Jul 23 03:35:29 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:29 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e" returned: 0 in 0.345s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.remotefs [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eb53154-ac50-4352-a065-32b2cf53ef05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88344) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec65b35-b8a6-4459-917b-50ef6aa41995]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:29 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:30 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05
Jul 23 03:35:30 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:30 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05" returned: 0 in 0.358s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:30 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e
Jul 23 03:35:30 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:30 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e" returned: 0 in 0.314s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:30 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e
Jul 23 03:35:30 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:30 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05.26a0f46c-c28b-4df3-af53-61a1f909fd8e" returned: 0 in 0.230s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-26a0f46c-c28b-4df3-af53-61a1f909fd8e" released by "_delete_snapshot" :: held 1.336s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-4eb53154-ac50-4352-a065-32b2cf53ef05" released by "delete_snapshot" :: held 1.357s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Created reservations ['e47ecf79-af27-44d0-a3ce-4c9b1abc1584', 'c7dc787d-f2fd-4c46-9033-f63792e320f8', 'bc51fe53-5a81-4862-802d-4a471d699757', '751191a9-0995-4eb9-8ab8-b4b11f6f607b'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:30 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Delete snapshot completed successfully.
Jul 23 03:35:30 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-1bca78d2-cf9f-4935-ac4b-994d44decfa1 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-26a0f46c-c28b-4df3-af53-61a1f909fd8e-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-4eb53154-ac50-4352-a065-32b2cf53ef05-delete_volume" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-4eb53154-ac50-4352-a065-32b2cf53ef05-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=102,cinder:UPDATE=160,cinder:INSERT=49,cinder:DELETE=14 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:INSERT=35,cinder:UPDATE=141,cinder:SELECT=131,cinder:DELETE=10 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "cinder-quobyte-4eb53154-ac50-4352-a065-32b2cf53ef05" by "delete_volume" {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-4eb53154-ac50-4352-a065-32b2cf53ef05" acquired by "delete_volume" :: waited 0.014s {{(pid=88344) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c67681f-d17b-4208-91f0-db07f8004a83]: (4, 'qcow2') {{(pid=90323) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 23 03:35:31 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:31 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05
Jul 23 03:35:31 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:32 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05" returned: 0 in 0.344s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:32 devstack sudo[108243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05
Jul 23 03:35:32 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:32 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8/volume-4eb53154-ac50-4352-a065-32b2cf53ef05" returned: 0 in 0.246s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-quobyte-4eb53154-ac50-4352-a065-32b2cf53ef05" released by "delete_volume" :: held 0.648s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG cinder.quota [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Created reservations ['d44dbc9d-a40b-4ded-83cf-940561c72213', '737a4600-04a4-46ea-86a1-fd72d725e8a2', '56f0f26b-3e4d-4993-897f-a92d4b5c2cea', 'e77441a3-6dc4-44a4-9736-519822dc52ac'] {{(pid=88344) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:32 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:35:32 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:32 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.229s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:35:32 devstack cinder-volume[88344]: INFO cinder.volume.manager [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Deleted volume successfully.
Jul 23 03:35:32 devstack cinder-volume[88344]: DEBUG cinder.coordination [None req-54863446-c3ec-4900-8ff4-0e8b973b0d61 tempest-ProjectReaderTests-2012163941 None] Lock "cinder-4eb53154-ac50-4352-a065-32b2cf53ef05-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88344) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 23 03:35:42 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:35:42 devstack cinder-volume[88344]: DEBUG dbcounter [-] [88344] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236': None} {{(pid=88344) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG cinder.volume.drivers.quobyte [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-27787191-e3c8-44d9-8562-38da72777236'] {{(pid=88344) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.lockutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88344) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 23 03:35:58 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8 {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 23 03:35:58 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8
Jul 23 03:35:58 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 23 03:35:59 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Jul 23 03:35:59 devstack cinder-volume[88344]: DEBUG oslo_concurrency.processutils [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5169260fc1a975cac5bd8ef1c10b2df8" returned: 0 in 0.245s {{(pid=88344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 23 03:35:59 devstack cinder-volume[88344]: DEBUG cinder.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Notifying Schedulers of capabilities ... {{(pid=88344) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 23 03:35:59 devstack cinder-volume[88344]: DEBUG oslo_service.periodic_task [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] Running periodic task VolumeManager._thread_info {{(pid=88344) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 23 03:35:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread count: 28 {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 23 03:35:59 devstack cinder-volume[88344]: DEBUG cinder.volume.manager [None req-039dc04c-e7e4-4c89-b614-b8b7d41ee549 None None] thread info: [<_MainThread(MainThread, started 126895990984832)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126895891191872)>, <Thread(Thread-3 (stat_writer), started daemon 126895880590656)>, <Thread(Rabbit-heartbeat, started daemon 126895879484096)>, <Thread(Thread-5 (_runner), started daemon 126895879652672)>, <Thread(Thread-7 (_runner), started daemon 126895877604864)>, <Thread(fd_logger, started daemon 126895873754816)>, <Thread(privsep_reader, started daemon 126895873765888)>, <Thread(tpool_thread_0, started daemon 126895866840768)>, <Thread(tpool_thread_1, started daemon 126895858448064)>, <Thread(tpool_thread_2, started daemon 126895850038976)>, <Thread(tpool_thread_3, started daemon 126895841629888)>, <Thread(tpool_thread_4, started daemon 126895833220800)>, <Thread(tpool_thread_5, started daemon 126895824811712)>, <Thread(tpool_thread_6, started daemon 126895816402624)>, <Thread(tpool_thread_7, started daemon 126895807993536)>, <Thread(tpool_thread_8, started daemon 126895799584448)>, <Thread(tpool_thread_9, started daemon 126895791175360)>, <Thread(tpool_thread_10, started daemon 126895782766272)>, <Thread(tpool_thread_11, started daemon 126895774357184)>, <Thread(tpool_thread_12, started daemon 126895765948096)>, <Thread(tpool_thread_13, started daemon 126895757539008)>, <Thread(tpool_thread_14, started daemon 126895749129920)>, <Thread(tpool_thread_15, started daemon 126895740720832)>, <Thread(tpool_thread_16, started daemon 126895732311744)>, <Thread(tpool_thread_17, started daemon 126895723902656)>, <Thread(tpool_thread_18, started daemon 126895715493568)>, <Thread(tpool_thread_19, started daemon 126895707084480)>] {{(pid=88344) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}